-- Logs begin at Fri 2022-07-01 15:40:25 UTC, end at Fri 2022-07-01 16:52:05 UTC. -- Jul 01 16:16:17.067133 dv-cinder-844961-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 01 16:16:17.074698 dv-cinder-844961-1-smb devstack@keystone.service[80125]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 16:16:17 2022] *** Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: nodename: dv-cinder-844961-1-smb Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: machine: x86_64 Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: clock source: unix Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: pcre jit disabled Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: detected number of CPU cores: 4 Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: current working directory: / Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: detected binary path: /usr/bin/uwsgi-core Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: your processes number limit is 47680 Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: your memory page size is 4096 bytes Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: detected max file descriptor number: 2048 Jul 01 16:16:17.076719 dv-cinder-844961-1-smb devstack@keystone.service[80125]: lock engine: pthread robust mutexes Jul 01 16:16:17.079164 dv-cinder-844961-1-smb devstack@keystone.service[80125]: thunder lock: enabled Jul 01 16:16:17.079164 dv-cinder-844961-1-smb devstack@keystone.service[80125]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 01 16:16:17.079164 dv-cinder-844961-1-smb devstack@keystone.service[80125]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 16:16:17.122256 dv-cinder-844961-1-smb devstack@keystone.service[80125]: Python main interpreter initialized at 0x5646ed36b9c0 Jul 01 16:16:17.122256 dv-cinder-844961-1-smb devstack@keystone.service[80125]: python threads support enabled Jul 01 16:16:17.122256 dv-cinder-844961-1-smb devstack@keystone.service[80125]: your server socket listen backlog is limited to 100 connections Jul 01 16:16:17.122256 dv-cinder-844961-1-smb devstack@keystone.service[80125]: your mercy for graceful operations on workers is 90 seconds Jul 01 16:16:17.122615 dv-cinder-844961-1-smb devstack@keystone.service[80125]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 16:16:17.122688 dv-cinder-844961-1-smb devstack@keystone.service[80125]: *** Operational MODE: preforking *** Jul 01 16:16:17.122943 dv-cinder-844961-1-smb devstack@keystone.service[80125]: *** uWSGI is running in multiple interpreter mode *** Jul 01 16:16:17.122943 dv-cinder-844961-1-smb devstack@keystone.service[80125]: spawned uWSGI master process (pid: 80125) Jul 01 16:16:17.123153 dv-cinder-844961-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 01 16:16:17.124250 dv-cinder-844961-1-smb devstack@keystone.service[80125]: spawned uWSGI worker 1 (pid: 80130, cores: 1) Jul 01 16:16:17.124250 dv-cinder-844961-1-smb devstack@keystone.service[80125]: spawned uWSGI worker 2 (pid: 80131, cores: 1) Jul 01 16:16:17.124250 dv-cinder-844961-1-smb devstack@keystone.service[80125]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 16:16:22.501084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:16:22.501084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: from cryptography.utils import int_from_bytes Jul 01 16:16:22.501922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:16:22.501922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: from cryptography.utils import int_from_bytes Jul 01 16:16:22.502322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:16:22.502322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: from cryptography.utils import int_from_bytes Jul 01 16:16:22.502428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 16:16:22.502428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: from cryptography.utils import int_from_bytes Jul 01 16:16:22.549840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 16:16:22.550031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 16:16:22.550107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 16:16:22.550186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] command line args: [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 16:16:22.550310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 16:16:22.550435 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 16:16:22.550523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] command line args: [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 16:16:22.550584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ================================================================================ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 16:16:22.550706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 16:16:22.550821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] admin_token = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.550902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ================================================================================ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 16:16:22.551095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] config_dir = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.551243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] admin_token = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.551325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.551403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] config_dir = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.551468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] config_source = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.551542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.551622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] debug = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.551689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] config_source = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.551753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] debug = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.552943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553066 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_config_append = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_config_append = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_dir = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_dir = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_file = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.553885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.554118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.554204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.554345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.554463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.554545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.554665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.554788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.554869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.554930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555050 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.555960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.556134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.556216 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.556347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.556467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.556548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.556675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.556750 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.556896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.556990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.557101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.557453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.557630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.557781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] publish_errors = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.557907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] publish_errors = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.558027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.558145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.558286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.558406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.558532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.558651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.558772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.558909 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.559036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.559195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.559353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] standard_threads = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.559473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] standard_threads = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.559649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.559768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.559889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.560020 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.560141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.560285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.560423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_journal = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.560550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_journal = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.560672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_json = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.560792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_json = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.560940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_stderr = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.561065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_stderr = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.561198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] use_syslog = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.561325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] use_syslog = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.561446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.561567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 16:16:22.561688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.561820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.561949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.562069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.562190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.562310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.562439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.562560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.562689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.562815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.562935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.563062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.563189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.563315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.563444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.563593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.563759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.563884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.563964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564563 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.564768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.565016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.565128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.565515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.565722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.565722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.565934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.566049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.566160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.566276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.566394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.566505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.566614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.566722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.566840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.566840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.567056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.567056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.567268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.567379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.567488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.567608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.567718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.567826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.567934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.568042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.568150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.568266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.568384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.568493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.568608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.568718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.568830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.569042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.569161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.569272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.569380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.569489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.569598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.569714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.569830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.569940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.570054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.570163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.570277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.570398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.570516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.570628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.570738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.570846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.570962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.571150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.571269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.571387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.571504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.571615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.571723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.571840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.571950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.572059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.572167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.572280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.572396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.572520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.572635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.572743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.572879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.572990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.573099 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.573220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.573331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.573440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.573549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.573658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.573766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.573884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.573994 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.574102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.574225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.574336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.574475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.574599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.574696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.574796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.574899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.574992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.575092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.575186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.575279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.575373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.575466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.575565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.575667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.575780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.575890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.576000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.576119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.576238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.576349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.576470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.576572 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.576689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.576801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.576955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.577075 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.577187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.577305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.577305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.577518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.577518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.577722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.577832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.577949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.578061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.578170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.578286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.578397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.578505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.578626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.578739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.578855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.578965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.579066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.579173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.579295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.579406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.579516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.579516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.579722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.579830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.579951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.580061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.580171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.580285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.580422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.580544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.580664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.580776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.580921 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.581036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.581147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.581147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.581363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.581481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.581592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.581701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.581811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.581920 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.582113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.582226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.582342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.582453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.582569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.582680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.582802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.582922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.583046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.583157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.583267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.583376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.583487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.583605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.583716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.583826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.583942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.584053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.584163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.584281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.584393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.584502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.584612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.584722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.584832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.585013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.585127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.585238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.585348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.585463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.585573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.585691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.external = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.585803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.585922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.586033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.external = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.586143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.586261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.586402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.586523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.586643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.password = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.586755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.586866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] auth.token = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.586977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.password = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.587089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.587199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] auth.token = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.587323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.587441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.587554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.587664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.587775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.587885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.588005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.588118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.588234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.588347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.588458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.588568 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.588690 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.588807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.588928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.589039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.589150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.589261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.589384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.589498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.589617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.589729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.589839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.589949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.590068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.590180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.590290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.590402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.590520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.590632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.590751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.590863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.590973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.591083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.591200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.591311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.591430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.591542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.591653 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.591763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.591872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.591982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.592100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.592213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.592323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.592433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.592551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.592663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.592781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.592933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.593046 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.593157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.593267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.593377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.593499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.593615 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.593726 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.593836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.593947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.594065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.594183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.594295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.594406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.594523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.594636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.594754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.594866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.594976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.595086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.595197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.595307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.595503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.595619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.595730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.595840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.595951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.596088 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.596218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.596337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.596449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.596560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.596677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.596789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.596930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.597044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.597044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.597252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.597371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.597484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.597602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.597716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.597827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.597940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.598051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.598161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.598279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.598391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.598502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.598618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.598730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.598846 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.598965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.599078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.599396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.599511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.599622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.599739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.599861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.599974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.600101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.600213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.600323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.600433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.600553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.600665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.600776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.600912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.601025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.601136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.601259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.601375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.601486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.601597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.601707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.601817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.601938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.602123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.602245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.602359 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.602469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.602580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.602700 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.602813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.602924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.603036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.603149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.603259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.603378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.603491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.603602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.603713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.603825 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.603936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.604056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.604169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.604280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.604391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.604502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.604613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.604732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.604860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.604966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.605080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.605190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.605301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.605425 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.605539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.605650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.605760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.605872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.605990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.606104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.606215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.606325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.606436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.606547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.606666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.606779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.606893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.607004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.607114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.607227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.607349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.607462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.607573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.607684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.607795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.607905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.608024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.608137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.608248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.608359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.608470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.608581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.608699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.608815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.608969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.609082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.609193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.609305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.609429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.609543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.609653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.609765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.609875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.609985 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.610104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.610216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.610328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.610439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.610549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.610660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.610780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.611233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.611345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.611456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.611569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.611680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.611799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.611912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.612024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.612134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.612245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.612355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.612475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.612588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.612699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.612699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.612922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.613033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.613156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.613270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.613380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.613380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.613590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.613701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.613820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.613932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.614043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.614159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.614272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.614382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.614502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.614614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.614724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.614835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.614946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.615056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.615175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.615288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.615398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.615508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.615619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.615729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.615847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.615960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.616070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.616180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.616290 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.616400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.616519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.616632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.616744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.616909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.617022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.617134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.617257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.617371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.617483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.617593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.617705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.617816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.618003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.618118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] role.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.618229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.618341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] role.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.618452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.618562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.618682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] role.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.618799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.618911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] role.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.619021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.619132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.619251 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.619364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.619475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.619586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.619697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.619808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.619927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.620040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.620151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.620261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.620372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.620481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.620600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.620712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.620824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.620950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.621061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.621172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.621294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.621409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.621520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.621630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.621630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.621841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.621964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.622078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.622078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.622287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.622401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.622511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.622630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.622743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.622855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.622967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.623078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.623188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.623307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.623420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.623534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.623644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.623754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.623873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.623986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.624097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.624208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.624321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.624432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.624551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.624663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.624774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.624898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.625010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.625121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.625242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.625357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.625468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.625579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.625689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.625800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.625917 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.626031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.626141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.626252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.626369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.626482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.626601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.626713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.626825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.626936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.627047 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.627159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.627277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.627421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.627534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.627645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.627756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.627867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.627986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.628099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.628210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.628321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.628432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.628542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.628661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.628773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.628773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629691 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.629913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.630131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.630251 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.630372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.630372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.630581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.630692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.630810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.630931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.631055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.631169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.631282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.631393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.631503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.631614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.631733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.631845 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.631956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.632070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.632187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.632300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.632420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.632533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.632644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.632754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.632880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.632993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.633117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.633231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.633342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.633454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.633565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.633676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.633795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.633908 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.634019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.634130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.634241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.634352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80130) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 16:16:22.634474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.634474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.634474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 16:16:22.634474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80131) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 16:16:22.663338 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.663547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.663774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.664349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.664581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.664807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.672127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.673209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.700240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.700441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.700948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.701182 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.845810 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.846902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.894732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.894962 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.895362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.895592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.958063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.958270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.958366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.958467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.958664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.958791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.958929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.959011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.959074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.959161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.959239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.959457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.983591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.983785 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.984972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.985209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.985387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.996605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:22.996822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.009396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.009640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.009786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.009927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.010010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.010085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.010238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.010378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.010518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.010599 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.010721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80130) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.010840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.010840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.011015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80131) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 01 16:16:23.027981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.028117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.028256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 16:16:23.028338 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 16:16:23.028517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.028643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.028781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 16:16:23.028926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 01 16:16:23.029007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.029091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.029213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.029305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.029482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.029609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.029751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.029846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.040500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.040628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.040758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.040868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.041006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.041166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.041288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.041381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.049687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.049813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.052984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.053111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.053242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.053327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.053524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.053671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.053811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.053888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.054064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.054191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.054343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.054426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.054567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.054694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.054832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.054912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.055072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.055198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.055337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.055418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.055577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.055718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.081996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.082274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.083610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.083874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.084022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.084164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.089155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.089368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.089496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.089635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.089813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.090021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.097219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.097442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.097567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.097720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.101927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.102138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.102238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.102438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.102584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.102723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.102806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.103010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.103102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.103245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.103347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.103543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.103669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.103807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.103887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.104046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.122970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.123173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.123300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.123437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.128047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.128258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.131685 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.131851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.131948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.132156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.137122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.137249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.140725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.140872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.144455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.144583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.144723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.144921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.145017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.145192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.145320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.145457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.145613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.145740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.145885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.145973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.164978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.165254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.165381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.165521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.165622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.165741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.165876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.165992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.173678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.174149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.175440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.175716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.175854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.176135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.178970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.179246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.179452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.179580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.179724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.179805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.179982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.180109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.180248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.180526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.193328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.193615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.193741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.193895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.193980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.194159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.194287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.194417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.194502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.194759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.195978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.196269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.196397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.196536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.214197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.214439 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.217476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.217687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.220776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.221177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.222574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.222913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.224211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.224491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.224616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.224755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.224837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.225083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.232166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.232293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.233833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.233962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.237481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.237610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.237749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.237949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.238137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.238288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.238382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.238591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.247533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.247681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.247822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.247916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.248075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.248202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.256129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80131) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.256268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80130) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 01 16:16:23.256418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.256638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.256703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.256888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.256979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.257158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.257264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.257515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.257606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.257800 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.257888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.258071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.258161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.258345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.258533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.258680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.258762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.258866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.258988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.259150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.259291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.259375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.259581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.259753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80131) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.260013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.260489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80130) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 01 16:16:23.297458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646ed36b9c0 pid: 80131 (default app) Jul 01 16:16:23.299600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5646ed36b9c0 pid: 80130 (default app) Jul 01 16:16:23.301271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdebffc-ee7d-44b2-99fc-c50bb5674830 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:23.301592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdebffc-ee7d-44b2-99fc-c50bb5674830 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:23.301862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdebffc-ee7d-44b2-99fc-c50bb5674830 None None] PATH_INFO: `/v3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:23.306166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Fri Jul 1 16:16:23 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:30.974440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5b44-c879-406e-84a5-ebad60d00054 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:30.975339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5b44-c879-406e-84a5-ebad60d00054 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:30.975339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa5b44-c879-406e-84a5-ebad60d00054 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:30.982500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:30 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:30.988369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:30.988808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:30.988930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:31.058193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: INFO dbcounter [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] Registered counter for database keystone Jul 01 16:16:31.082098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG oslo_db.sqlalchemy.engines [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80131) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:16:31.089358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writer thread running {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:16:31.267506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG passlib.handlers.bcrypt [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80131) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 01 16:16:31.267941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG passlib.handlers.bcrypt [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80131) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 01 16:16:31.322635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:31.324172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:31.456805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 01 16:16:31.673159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5b44-c879-406e-84a5-ebad60d00054 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:31.757640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: INFO dbcounter [None req-e2aa5b44-c879-406e-84a5-ebad60d00054 None None] Registered counter for database keystone Jul 01 16:16:31.778770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG oslo_db.sqlalchemy.engines [None req-e2aa5b44-c879-406e-84a5-ebad60d00054 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80130) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 16:16:31.789278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writer thread running {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 16:16:31.914520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa5b44-c879-406e-84a5-ebad60d00054 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:31.919705 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ed447-4a8b-4b0b-9744-020dd0d0238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:31.920371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed447-4a8b-4b0b-9744-020dd0d0238c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:31.920657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed447-4a8b-4b0b-9744-020dd0d0238c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:31.920956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ed447-4a8b-4b0b-9744-020dd0d0238c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:31.929641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed447-4a8b-4b0b-9744-020dd0d0238c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:31.981081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c9ed447-4a8b-4b0b-9744-020dd0d0238c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 01 16:16:31.981744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ed447-4a8b-4b0b-9744-020dd0d0238c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:31.992356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Fri Jul 1 16:16:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 16:16:31.998889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:32.014972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f154a-43f5-412e-b612-f5f5f06dd0c3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:32.020617 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed693f-8de4-4f14-8850-fe56a776f3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:32.021786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed693f-8de4-4f14-8850-fe56a776f3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:32.022078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed693f-8de4-4f14-8850-fe56a776f3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:32.022353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed693f-8de4-4f14-8850-fe56a776f3c6 admin admin] PATH_INFO: `/v3/projects/41f78c5209a64d8eb2f67286358f8191` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:32.026682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed693f-8de4-4f14-8850-fe56a776f3c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=41f78c5209a64d8eb2f67286358f8191)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:32.077162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: WARNING keystone.common.rbac_enforcer.enforcer [None req-57ed693f-8de4-4f14-8850-fe56a776f3c6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 01 16:16:32.077476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed693f-8de4-4f14-8850-fe56a776f3c6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:32.082108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Fri Jul 1 16:16:31 2022] GET /identity/v3/projects/41f78c5209a64d8eb2f67286358f8191 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:34.100609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f122-746e-472e-ab61-f521a8003582 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:34.101250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f122-746e-472e-ab61-f521a8003582 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:34.101461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f122-746e-472e-ab61-f521a8003582 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:34.106713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:16:34.114562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6a1e-657b-4c32-be7b-6124688b35b0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:34.115306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6a1e-657b-4c32-be7b-6124688b35b0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:34.115463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6a1e-657b-4c32-be7b-6124688b35b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:34.146229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1ffe6a1e-657b-4c32-be7b-6124688b35b0 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:34.147759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1ffe6a1e-657b-4c32-be7b-6124688b35b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:34.157198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 01 16:16:34.179492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184f122-746e-472e-ab61-f521a8003582 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:34.194148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184f122-746e-472e-ab61-f521a8003582 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:34.199471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142855b-75a2-4f5d-a947-141f5fd17e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:34.200102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142855b-75a2-4f5d-a947-141f5fd17e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:34.200381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142855b-75a2-4f5d-a947-141f5fd17e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:34.200650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142855b-75a2-4f5d-a947-141f5fd17e04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:34.209314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142855b-75a2-4f5d-a947-141f5fd17e04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:34.211102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142855b-75a2-4f5d-a947-141f5fd17e04 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:34.219970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Fri Jul 1 16:16:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:16:34.225546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6a1e-657b-4c32-be7b-6124688b35b0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:34.235984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6a1e-657b-4c32-be7b-6124688b35b0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:34.241854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352208af-bf1f-44fd-af69-e8bd91b12f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:34.242769 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352208af-bf1f-44fd-af69-e8bd91b12f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:34.243051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352208af-bf1f-44fd-af69-e8bd91b12f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:34.243306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352208af-bf1f-44fd-af69-e8bd91b12f50 admin admin] PATH_INFO: `/v3/users/355fb13b7be647a8a84fa02e8179fe7a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:34.244837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352208af-bf1f-44fd-af69-e8bd91b12f50 admin admin] RBAC: Authorizing `identity:get_user(user_id=355fb13b7be647a8a84fa02e8179fe7a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:34.246718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352208af-bf1f-44fd-af69-e8bd91b12f50 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:34.248322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Fri Jul 1 16:16:34 2022] GET /identity/v3/users/355fb13b7be647a8a84fa02e8179fe7a => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:36.316613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509bee-5122-4178-8399-2e311b823042 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:36.317236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509bee-5122-4178-8399-2e311b823042 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:36.317236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509bee-5122-4178-8399-2e311b823042 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:36.318569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:36.323750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce741-6b0e-41b6-9703-1c80eec82dca None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:36.324155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce741-6b0e-41b6-9703-1c80eec82dca None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:36.324300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dce741-6b0e-41b6-9703-1c80eec82dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:36.341396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-34dce741-6b0e-41b6-9703-1c80eec82dca None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:36.342567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-34dce741-6b0e-41b6-9703-1c80eec82dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:36.346620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fd6a0-0973-4d6d-b42e-0f16cd7ddab0 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:36.346995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fd6a0-0973-4d6d-b42e-0f16cd7ddab0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:36.347410 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fd6a0-0973-4d6d-b42e-0f16cd7ddab0 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:36.349597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:36.357102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52a28-872f-4d2d-88e0-ecd9f2fbae9d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:36.357388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52a28-872f-4d2d-88e0-ecd9f2fbae9d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:36.357662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52a28-872f-4d2d-88e0-ecd9f2fbae9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:36.397950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG passlib.handlers.bcrypt [None req-68f52a28-872f-4d2d-88e0-ecd9f2fbae9d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80130) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 01 16:16:36.398363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG passlib.handlers.bcrypt [None req-68f52a28-872f-4d2d-88e0-ecd9f2fbae9d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80130) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 01 16:16:36.436500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:36.443515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-68f52a28-872f-4d2d-88e0-ecd9f2fbae9d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:36.445200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-68f52a28-872f-4d2d-88e0-ecd9f2fbae9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:36.459862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dce741-6b0e-41b6-9703-1c80eec82dca None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:36.484575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:36.546943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:36.565140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dce741-6b0e-41b6-9703-1c80eec82dca None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:36.569488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f52a28-872f-4d2d-88e0-ecd9f2fbae9d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:36.599795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f3504-2669-41f0-9bfe-2cabe5988164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:36.600712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f3504-2669-41f0-9bfe-2cabe5988164 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:36.601007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f3504-2669-41f0-9bfe-2cabe5988164 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:36.601197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f3504-2669-41f0-9bfe-2cabe5988164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:36.613600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f3504-2669-41f0-9bfe-2cabe5988164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-972f3504-2669-41f0-9bfe-2cabe5988164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:36.624877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:36.625821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:16:36.626878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:16:36.632040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f3504-2669-41f0-9bfe-2cabe5988164 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:36.672809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f52a28-872f-4d2d-88e0-ecd9f2fbae9d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:36.675125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:36.711051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7927f9-d280-4068-9c8e-9cac0d977c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:36.711963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7927f9-d280-4068-9c8e-9cac0d977c28 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:36.712259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7927f9-d280-4068-9c8e-9cac0d977c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:36.712541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7927f9-d280-4068-9c8e-9cac0d977c28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:36.714819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:36.734777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f3504-2669-41f0-9bfe-2cabe5988164 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:36.769928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408e3e6-f8d6-43a5-86e0-b4d054918791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:36.770609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408e3e6-f8d6-43a5-86e0-b4d054918791 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:36.770891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408e3e6-f8d6-43a5-86e0-b4d054918791 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:36.771170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408e3e6-f8d6-43a5-86e0-b4d054918791 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:36.771940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408e3e6-f8d6-43a5-86e0-b4d054918791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:36.772250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408e3e6-f8d6-43a5-86e0-b4d054918791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:36.773728 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408e3e6-f8d6-43a5-86e0-b4d054918791 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:36.781165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7927f9-d280-4068-9c8e-9cac0d977c28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:36.782742 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7927f9-d280-4068-9c8e-9cac0d977c28 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:36.785448 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:16:36.791108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408e3e6-f8d6-43a5-86e0-b4d054918791 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:36.888212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 16:16:36.894094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7927f9-d280-4068-9c8e-9cac0d977c28 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:36.894810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408e3e6-f8d6-43a5-86e0-b4d054918791 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:36.897021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:36.929609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789edf88-76a6-462f-af92-25bce2d4210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:36.930499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789edf88-76a6-462f-af92-25bce2d4210a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:36.930781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789edf88-76a6-462f-af92-25bce2d4210a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:36.931056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789edf88-76a6-462f-af92-25bce2d4210a None admin] PATH_INFO: `/v3/users/355fb13b7be647a8a84fa02e8179fe7a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:36.932279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789edf88-76a6-462f-af92-25bce2d4210a None admin] RBAC: Authorizing `identity:get_user(user_id=355fb13b7be647a8a84fa02e8179fe7a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:36.933811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789edf88-76a6-462f-af92-25bce2d4210a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:36.935453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:36 2022] GET /identity/v3/users/355fb13b7be647a8a84fa02e8179fe7a => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:16:36.940929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789edf88-76a6-462f-af92-25bce2d4210a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:36.954875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:36.998196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7927f9-d280-4068-9c8e-9cac0d977c28 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:37.038110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfb2bc-ee1c-4330-919c-c3ab3349292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:37.038932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb2bc-ee1c-4330-919c-c3ab3349292e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:37.039213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb2bc-ee1c-4330-919c-c3ab3349292e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:37.039486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfb2bc-ee1c-4330-919c-c3ab3349292e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:37.054952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789edf88-76a6-462f-af92-25bce2d4210a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:37.059379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfb2bc-ee1c-4330-919c-c3ab3349292e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:37.060870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfb2bc-ee1c-4330-919c-c3ab3349292e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-9bbfb2bc-ee1c-4330-919c-c3ab3349292e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:16:37.081440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:37.082463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:37.083358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:16:37.083358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:16:37.083358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:16:37.083358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:16:37.083358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 9/18] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:37.088422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfb2bc-ee1c-4330-919c-c3ab3349292e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:37.092329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f7e67-6cde-4440-9d50-ce44fb799cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:37.093245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f7e67-6cde-4440-9d50-ce44fb799cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:37.093522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f7e67-6cde-4440-9d50-ce44fb799cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:37.093793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f7e67-6cde-4440-9d50-ce44fb799cf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:37.094969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f7e67-6cde-4440-9d50-ce44fb799cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:37.096486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f7e67-6cde-4440-9d50-ce44fb799cf1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:37.098140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 10/19] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:37.103789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f7e67-6cde-4440-9d50-ce44fb799cf1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:37.143878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:37.184225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:37.188556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfb2bc-ee1c-4330-919c-c3ab3349292e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:37.203478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f7e67-6cde-4440-9d50-ce44fb799cf1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:37.221970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33db973-be7b-44ba-ba27-8e9575f8e298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:37.222635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33db973-be7b-44ba-ba27-8e9575f8e298 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:37.222920 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33db973-be7b-44ba-ba27-8e9575f8e298 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:37.223199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33db973-be7b-44ba-ba27-8e9575f8e298 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:37.223927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33db973-be7b-44ba-ba27-8e9575f8e298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:37.224233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33db973-be7b-44ba-ba27-8e9575f8e298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:37.225669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33db973-be7b-44ba-ba27-8e9575f8e298 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:37.237852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0239-c06a-4053-9433-ebe15fe251f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:37.238515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0239-c06a-4053-9433-ebe15fe251f5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:37.238798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0239-c06a-4053-9433-ebe15fe251f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:37.239069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0239-c06a-4053-9433-ebe15fe251f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:37.239909 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0239-c06a-4053-9433-ebe15fe251f5 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.domain.id=default, user.id=355fb13b7be647a8a84fa02e8179fe7a) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:37.240218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0239-c06a-4053-9433-ebe15fe251f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:37.241700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0239-c06a-4053-9433-ebe15fe251f5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:37.243079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 10/20] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:37.248898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 11/21] 10.222.0.59 () {56 vars in 1322 bytes} [Fri Jul 1 16:16:37 2022] GET /identity/v3/role_assignments?user.id=355fb13b7be647a8a84fa02e8179fe7a&scope.domain.id=default&role.id=842af9e8967047df873d061df391e820 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:16:39.791540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc9b34-b0eb-4d22-9e13-3324db6bc299 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:39.792537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc9b34-b0eb-4d22-9e13-3324db6bc299 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:39.793067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc9b34-b0eb-4d22-9e13-3324db6bc299 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:39.794695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 11/22] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:39.802368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ee282-b0b8-48c5-ae62-7058c178ea89 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:39.802368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ee282-b0b8-48c5-ae62-7058c178ea89 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:39.802368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ee282-b0b8-48c5-ae62-7058c178ea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:39.818944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d63ee282-b0b8-48c5-ae62-7058c178ea89 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:39.820486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d63ee282-b0b8-48c5-ae62-7058c178ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:39.889892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 12/23] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:39.912678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc9b34-b0eb-4d22-9e13-3324db6bc299 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:40.019802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc9b34-b0eb-4d22-9e13-3324db6bc299 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:40.041212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:40.056528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ac9e6-680e-4fc4-9cf2-ec89a545de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:40.057368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ac9e6-680e-4fc4-9cf2-ec89a545de2b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.057652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ac9e6-680e-4fc4-9cf2-ec89a545de2b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.057924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ac9e6-680e-4fc4-9cf2-ec89a545de2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.070182 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ac9e6-680e-4fc4-9cf2-ec89a545de2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-2c3ac9e6-680e-4fc4-9cf2-ec89a545de2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:40.079134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:40.080095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:16:40.081333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 12/24] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:16:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:40.086836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ee282-b0b8-48c5-ae62-7058c178ea89 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:40.097056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499629c-6f9e-4982-85ce-55380fd30cb3 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.097345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499629c-6f9e-4982-85ce-55380fd30cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.097622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499629c-6f9e-4982-85ce-55380fd30cb3 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.099199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 13/25] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:16:40.106146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4837508-1802-4cac-99ae-53f5a37ade61 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.106429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4837508-1802-4cac-99ae-53f5a37ade61 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.106701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4837508-1802-4cac-99ae-53f5a37ade61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.133368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a4837508-1802-4cac-99ae-53f5a37ade61 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:40.134576 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a4837508-1802-4cac-99ae-53f5a37ade61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:40.202966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 14/26] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:40.204303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb2118-0021-4988-b613-1fc404ce8c5d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.204651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb2118-0021-4988-b613-1fc404ce8c5d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.205137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb2118-0021-4988-b613-1fc404ce8c5d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.206412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 15/27] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:40.210558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727ae45-8ed4-49f7-883f-99297881d760 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.210558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727ae45-8ed4-49f7-883f-99297881d760 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.210558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727ae45-8ed4-49f7-883f-99297881d760 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.210558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 16/28] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:40.214266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930768-2e90-4cf1-9f07-36bf1470bf57 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.214557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930768-2e90-4cf1-9f07-36bf1470bf57 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.214835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930768-2e90-4cf1-9f07-36bf1470bf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.226847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:40.231659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fa930768-2e90-4cf1-9f07-36bf1470bf57 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:40.233118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fa930768-2e90-4cf1-9f07-36bf1470bf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:40.257670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ee282-b0b8-48c5-ae62-7058c178ea89 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:40.297269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea4ea5-6742-495d-85e3-354bce59aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:40.298458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea4ea5-6742-495d-85e3-354bce59aea1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.298884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea4ea5-6742-495d-85e3-354bce59aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.299422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ea4ea5-6742-495d-85e3-354bce59aea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.300648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea4ea5-6742-495d-85e3-354bce59aea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:40.301363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea4ea5-6742-495d-85e3-354bce59aea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:40.303386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ea4ea5-6742-495d-85e3-354bce59aea1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:40.311689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 17/29] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:40.313342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e6123-15e7-4d01-a669-12957eb31cb4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.313786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e6123-15e7-4d01-a669-12957eb31cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.314149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e6123-15e7-4d01-a669-12957eb31cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.314392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 13/30] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:40.315158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea4ea5-6742-495d-85e3-354bce59aea1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:40.339152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-937e6123-15e7-4d01-a669-12957eb31cb4 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:40.340362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-937e6123-15e7-4d01-a669-12957eb31cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:40.372294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:40.424970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 18/31] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:40.426174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e6123-15e7-4d01-a669-12957eb31cb4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:40.446985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ea4ea5-6742-495d-85e3-354bce59aea1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:40.495233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732ea6e-1fbf-4a57-9f55-fac35ef29314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:40.495915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732ea6e-1fbf-4a57-9f55-fac35ef29314 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.496196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732ea6e-1fbf-4a57-9f55-fac35ef29314 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.496477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732ea6e-1fbf-4a57-9f55-fac35ef29314 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.497570 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732ea6e-1fbf-4a57-9f55-fac35ef29314 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:40.499393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732ea6e-1fbf-4a57-9f55-fac35ef29314 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:40.506820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:40.557488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e6123-15e7-4d01-a669-12957eb31cb4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:40.593310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278331a7-fd72-4df5-b2b7-832ddeccb0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:40.594555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278331a7-fd72-4df5-b2b7-832ddeccb0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.595118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278331a7-fd72-4df5-b2b7-832ddeccb0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.595644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278331a7-fd72-4df5-b2b7-832ddeccb0f1 None admin] PATH_INFO: `/v3/users/355fb13b7be647a8a84fa02e8179fe7a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.597512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278331a7-fd72-4df5-b2b7-832ddeccb0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=355fb13b7be647a8a84fa02e8179fe7a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:40.599253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278331a7-fd72-4df5-b2b7-832ddeccb0f1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:40.601116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 19/32] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:40 2022] GET /identity/v3/users/355fb13b7be647a8a84fa02e8179fe7a => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:40.602053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278331a7-fd72-4df5-b2b7-832ddeccb0f1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:40.637629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:40.668705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 14/33] 10.222.0.59 () {60 vars in 1131 bytes} [Fri Jul 1 16:16:40 2022] POST /identity/v3/roles => generated 219 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:16:40.670137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732ea6e-1fbf-4a57-9f55-fac35ef29314 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:40.766822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278331a7-fd72-4df5-b2b7-832ddeccb0f1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:40.843092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008ac04-8a08-4118-a2db-26798f0294ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:40.843772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008ac04-8a08-4118-a2db-26798f0294ad None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.844053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008ac04-8a08-4118-a2db-26798f0294ad None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.844328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008ac04-8a08-4118-a2db-26798f0294ad None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.845293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008ac04-8a08-4118-a2db-26798f0294ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:40.846704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008ac04-8a08-4118-a2db-26798f0294ad None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:40.883479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732ea6e-1fbf-4a57-9f55-fac35ef29314 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:40.924009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b336906-975b-4832-a8d7-0f3dfccb750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:40.925292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b336906-975b-4832-a8d7-0f3dfccb750b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:40.925771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b336906-975b-4832-a8d7-0f3dfccb750b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:40.926310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b336906-975b-4832-a8d7-0f3dfccb750b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:40.938744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b336906-975b-4832-a8d7-0f3dfccb750b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:40.940782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b336906-975b-4832-a8d7-0f3dfccb750b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4b336906-975b-4832-a8d7-0f3dfccb750b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:16:40.960797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:40.961673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:40.962506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:16:40.962506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:16:40.962506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:16:40.962506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:16:40.963209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 15/34] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:40.963983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b336906-975b-4832-a8d7-0f3dfccb750b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:41.001112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 20/35] 10.222.0.59 () {60 vars in 1131 bytes} [Fri Jul 1 16:16:40 2022] POST /identity/v3/roles => generated 225 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:16:41.003465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b863c-0665-4683-80c5-0e47c9fca8de None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.003760 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b863c-0665-4683-80c5-0e47c9fca8de None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.004037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b863c-0665-4683-80c5-0e47c9fca8de None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.005437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 21/36] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:41.009723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b863c-0665-4683-80c5-0e47c9fca8de None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:41.029611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:41.092189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b336906-975b-4832-a8d7-0f3dfccb750b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:41.136833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:41.137574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9a35ce-ab55-4532-808f-0ed30439da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:41.139846 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a35ce-ab55-4532-808f-0ed30439da06 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.140318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a35ce-ab55-4532-808f-0ed30439da06 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.140887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a35ce-ab55-4532-808f-0ed30439da06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.143189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a35ce-ab55-4532-808f-0ed30439da06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:41.145796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9a35ce-ab55-4532-808f-0ed30439da06 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:41.147957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 16/37] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:41.149616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b05246-19ee-4143-b848-6ae66b6f4565 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.150031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b05246-19ee-4143-b848-6ae66b6f4565 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.150427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b05246-19ee-4143-b848-6ae66b6f4565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.153266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b863c-0665-4683-80c5-0e47c9fca8de None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:41.173875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b3b05246-19ee-4143-b848-6ae66b6f4565 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:41.176089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b3b05246-19ee-4143-b848-6ae66b6f4565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:41.196196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2377f-4ac5-4548-95ab-21468c97987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:41.196951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2377f-4ac5-4548-95ab-21468c97987a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.197263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2377f-4ac5-4548-95ab-21468c97987a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.197549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2377f-4ac5-4548-95ab-21468c97987a None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.198272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2377f-4ac5-4548-95ab-21468c97987a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:41.198584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2377f-4ac5-4548-95ab-21468c97987a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:41.200127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2377f-4ac5-4548-95ab-21468c97987a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:41.214870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 22/38] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:41.215903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2377f-4ac5-4548-95ab-21468c97987a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:41.271896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 17/39] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:41.273174 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b05246-19ee-4143-b848-6ae66b6f4565 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:41.322066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:41.329188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2377f-4ac5-4548-95ab-21468c97987a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:41.363340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafbbbd-b78c-4c71-ac91-cf4ebf5ed9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:41.364225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafbbbd-b78c-4c71-ac91-cf4ebf5ed9bf None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.364498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafbbbd-b78c-4c71-ac91-cf4ebf5ed9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.364770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cafbbbd-b78c-4c71-ac91-cf4ebf5ed9bf None admin] PATH_INFO: `/v3/domains/default/users/355fb13b7be647a8a84fa02e8179fe7a/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.366956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafbbbd-b78c-4c71-ac91-cf4ebf5ed9bf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=355fb13b7be647a8a84fa02e8179fe7a, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:41.368413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cafbbbd-b78c-4c71-ac91-cf4ebf5ed9bf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:41.376325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b05246-19ee-4143-b848-6ae66b6f4565 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:41.384279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 23/40] 10.222.0.59 () {58 vars in 1361 bytes} [Fri Jul 1 16:16:41 2022] PUT /identity/v3/domains/default/users/355fb13b7be647a8a84fa02e8179fe7a/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:16:41.385110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafbbbd-b78c-4c71-ac91-cf4ebf5ed9bf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:41.403823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:41.421344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eab834-9971-4216-ab31-f8b3db6dcc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:41.422043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab834-9971-4216-ab31-f8b3db6dcc7c None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.422320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab834-9971-4216-ab31-f8b3db6dcc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.422597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eab834-9971-4216-ab31-f8b3db6dcc7c None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.423454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eab834-9971-4216-ab31-f8b3db6dcc7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:41.425049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eab834-9971-4216-ab31-f8b3db6dcc7c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:41.461137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 18/41] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:16:41 2022] POST /identity/v3/projects => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:16:41.463391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1caba7-bf62-4ecf-9efd-0bf5e69061d7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.463925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1caba7-bf62-4ecf-9efd-0bf5e69061d7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.464376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1caba7-bf62-4ecf-9efd-0bf5e69061d7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.466109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 19/42] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:41.483957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a63c-e1f9-4aad-afea-e75f3a1cd3aa None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.484610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a63c-e1f9-4aad-afea-e75f3a1cd3aa None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.485885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4a63c-e1f9-4aad-afea-e75f3a1cd3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.518695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-08c4a63c-e1f9-4aad-afea-e75f3a1cd3aa None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:41.521444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-08c4a63c-e1f9-4aad-afea-e75f3a1cd3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:41.527119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cafbbbd-b78c-4c71-ac91-cf4ebf5ed9bf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:41.570598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f344354-0bc6-478b-b3fd-652cb07577de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:41.571654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f344354-0bc6-478b-b3fd-652cb07577de None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.571654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f344354-0bc6-478b-b3fd-652cb07577de None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.571824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f344354-0bc6-478b-b3fd-652cb07577de None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.572659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f344354-0bc6-478b-b3fd-652cb07577de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:41.574197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f344354-0bc6-478b-b3fd-652cb07577de None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:41.591982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 24/43] 10.222.0.59 () {60 vars in 1131 bytes} [Fri Jul 1 16:16:41 2022] POST /identity/v3/roles => generated 223 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:16:41.622404 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 20/44] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:41.647719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f344354-0bc6-478b-b3fd-652cb07577de None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:41.736547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:41.767396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f344354-0bc6-478b-b3fd-652cb07577de None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:41.803087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac213-02fa-46bd-b9b9-2e851d327b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:41.803905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac213-02fa-46bd-b9b9-2e851d327b8d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:41.804193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac213-02fa-46bd-b9b9-2e851d327b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:41.804476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac213-02fa-46bd-b9b9-2e851d327b8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:41.805769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac213-02fa-46bd-b9b9-2e851d327b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:41.807351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac213-02fa-46bd-b9b9-2e851d327b8d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:41.809034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 25/45] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:41.814852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4a63c-e1f9-4aad-afea-e75f3a1cd3aa None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:41.843184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:41.919976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4a63c-e1f9-4aad-afea-e75f3a1cd3aa None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:42.073348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df92b55c-2c0d-4bbd-a83e-b45599ca4e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:42.073930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b55c-2c0d-4bbd-a83e-b45599ca4e4c None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:42.074205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b55c-2c0d-4bbd-a83e-b45599ca4e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:42.074457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92b55c-2c0d-4bbd-a83e-b45599ca4e4c None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:42.075191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b55c-2c0d-4bbd-a83e-b45599ca4e4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:42.076671 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df92b55c-2c0d-4bbd-a83e-b45599ca4e4c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:42.104536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 21/46] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:16:41 2022] POST /identity/v3/projects => generated 312 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:16:43.447828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2c74-b25e-48e9-ae57-73a950703b47 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:43.448349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2c74-b25e-48e9-ae57-73a950703b47 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:43.448510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f2c74-b25e-48e9-ae57-73a950703b47 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:43.449962 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 26/47] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:43.455488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60706d49-927b-4897-a86f-ab33d060f8e3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:43.455861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60706d49-927b-4897-a86f-ab33d060f8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:43.456036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60706d49-927b-4897-a86f-ab33d060f8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:43.475106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-60706d49-927b-4897-a86f-ab33d060f8e3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:43.476339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-60706d49-927b-4897-a86f-ab33d060f8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:43.547422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 22/48] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:43.570790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2c74-b25e-48e9-ae57-73a950703b47 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:43.676887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f2c74-b25e-48e9-ae57-73a950703b47 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:43.711603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e4cfb-9e28-43ee-99fb-df718d9c02f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:43.712318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e4cfb-9e28-43ee-99fb-df718d9c02f7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:43.712604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e4cfb-9e28-43ee-99fb-df718d9c02f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:43.712873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e4cfb-9e28-43ee-99fb-df718d9c02f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:43.723675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e4cfb-9e28-43ee-99fb-df718d9c02f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f91e4cfb-9e28-43ee-99fb-df718d9c02f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:43.731320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:43.732180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:16:43.733038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 27/49] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:16:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:43.741408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60706d49-927b-4897-a86f-ab33d060f8e3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:43.753926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:43.845784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60706d49-927b-4897-a86f-ab33d060f8e3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:43.882187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe8c4-85c6-4ca5-b912-62e5c4a74360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:43.882864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe8c4-85c6-4ca5-b912-62e5c4a74360 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:43.883150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe8c4-85c6-4ca5-b912-62e5c4a74360 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:43.883423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe8c4-85c6-4ca5-b912-62e5c4a74360 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:43.884192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fe8c4-85c6-4ca5-b912-62e5c4a74360 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:43.884502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fe8c4-85c6-4ca5-b912-62e5c4a74360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:43.885947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5fe8c4-85c6-4ca5-b912-62e5c4a74360 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:43.894300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 23/50] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:43.899961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e4cfb-9e28-43ee-99fb-df718d9c02f7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:43.903517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:44.009285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e4cfb-9e28-43ee-99fb-df718d9c02f7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:44.044232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d6389-65a9-47e4-bcca-8006a97fe49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:44.045150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d6389-65a9-47e4-bcca-8006a97fe49f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:44.045436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d6389-65a9-47e4-bcca-8006a97fe49f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:44.045714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d6389-65a9-47e4-bcca-8006a97fe49f None admin] PATH_INFO: `/v3/users/355fb13b7be647a8a84fa02e8179fe7a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:44.046955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d6389-65a9-47e4-bcca-8006a97fe49f None admin] RBAC: Authorizing `identity:get_user(user_id=355fb13b7be647a8a84fa02e8179fe7a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:44.048457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d6389-65a9-47e4-bcca-8006a97fe49f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:44.050133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 28/51] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:43 2022] GET /identity/v3/users/355fb13b7be647a8a84fa02e8179fe7a => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:44.055737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe8c4-85c6-4ca5-b912-62e5c4a74360 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:44.089569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276676e-356d-4d95-bffd-ff5cdefa051f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:44.089857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276676e-356d-4d95-bffd-ff5cdefa051f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:44.090141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276676e-356d-4d95-bffd-ff5cdefa051f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:44.091538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 29/52] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:44.096971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b08a6-f9f7-4c88-b47b-653a65c40ce4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:44.097259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b08a6-f9f7-4c88-b47b-653a65c40ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:44.097535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b08a6-f9f7-4c88-b47b-653a65c40ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:44.115668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-265b08a6-f9f7-4c88-b47b-653a65c40ce4 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:44.117228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-265b08a6-f9f7-4c88-b47b-653a65c40ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:44.129972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:44.162984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe8c4-85c6-4ca5-b912-62e5c4a74360 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:44.200980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738c155-ddde-4978-9e28-ee96fa0c5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:44.201813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c155-ddde-4978-9e28-ee96fa0c5133 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:44.202093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c155-ddde-4978-9e28-ee96fa0c5133 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:44.202372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f738c155-ddde-4978-9e28-ee96fa0c5133 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:44.203716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738c155-ddde-4978-9e28-ee96fa0c5133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:44.205352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f738c155-ddde-4978-9e28-ee96fa0c5133 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:44.207086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 24/53] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:44.213407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738c155-ddde-4978-9e28-ee96fa0c5133 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:44.293957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:44.299446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 30/54] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:16:44.321232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f738c155-ddde-4978-9e28-ee96fa0c5133 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:44.322047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b08a6-f9f7-4c88-b47b-653a65c40ce4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:44.354791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7274c-3bff-43ce-8414-85f7739336a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:44.355433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7274c-3bff-43ce-8414-85f7739336a7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:44.355730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7274c-3bff-43ce-8414-85f7739336a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:44.356003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7274c-3bff-43ce-8414-85f7739336a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:44.356831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7274c-3bff-43ce-8414-85f7739336a7 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.domain.id=default, user.id=355fb13b7be647a8a84fa02e8179fe7a) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:44.357172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7274c-3bff-43ce-8414-85f7739336a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:44.358633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7274c-3bff-43ce-8414-85f7739336a7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:44.365182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 25/55] 10.222.0.59 () {56 vars in 1322 bytes} [Fri Jul 1 16:16:44 2022] GET /identity/v3/role_assignments?user.id=355fb13b7be647a8a84fa02e8179fe7a&scope.domain.id=default&role.id=842af9e8967047df873d061df391e820 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:16:44.431273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b08a6-f9f7-4c88-b47b-653a65c40ce4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:44.468068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b18209a-519a-4709-a1bf-6c3684ba92f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:44.468904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18209a-519a-4709-a1bf-6c3684ba92f3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:44.469261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18209a-519a-4709-a1bf-6c3684ba92f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:44.469453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18209a-519a-4709-a1bf-6c3684ba92f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:44.470809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18209a-519a-4709-a1bf-6c3684ba92f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:44.472332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b18209a-519a-4709-a1bf-6c3684ba92f3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:44.474356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 31/56] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:16:44.480751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7274c-3bff-43ce-8414-85f7739336a7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:44.485467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:44.588439 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7274c-3bff-43ce-8414-85f7739336a7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:44.621806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80aa51-9b0b-4829-b789-612c2b2bad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:44.622499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80aa51-9b0b-4829-b789-612c2b2bad91 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:44.622783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80aa51-9b0b-4829-b789-612c2b2bad91 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:44.623069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80aa51-9b0b-4829-b789-612c2b2bad91 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:44.623792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80aa51-9b0b-4829-b789-612c2b2bad91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:44.625323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80aa51-9b0b-4829-b789-612c2b2bad91 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:44.654746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 26/57] 10.222.0.59 () {60 vars in 1140 bytes} [Fri Jul 1 16:16:44 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:16:46.665327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977d3da-98d8-40ee-b25a-e139feb4d631 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:46.665894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977d3da-98d8-40ee-b25a-e139feb4d631 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:46.665894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977d3da-98d8-40ee-b25a-e139feb4d631 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:46.667453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 32/58] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:46.673886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca147ed-a3f7-480e-9940-c981af1ae7f0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:46.674559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca147ed-a3f7-480e-9940-c981af1ae7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:46.674881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca147ed-a3f7-480e-9940-c981af1ae7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:46.702330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9ca147ed-a3f7-480e-9940-c981af1ae7f0 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:46.704265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9ca147ed-a3f7-480e-9940-c981af1ae7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:46.757772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:46.775455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 27/59] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:46.800161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977d3da-98d8-40ee-b25a-e139feb4d631 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:46.877248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:46.914732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977d3da-98d8-40ee-b25a-e139feb4d631 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:46.948907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613da1f-b606-4058-8e0e-b85667faea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:46.949635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613da1f-b606-4058-8e0e-b85667faea69 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:46.949917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613da1f-b606-4058-8e0e-b85667faea69 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:46.950199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613da1f-b606-4058-8e0e-b85667faea69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:46.951441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613da1f-b606-4058-8e0e-b85667faea69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:46.952938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613da1f-b606-4058-8e0e-b85667faea69 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:46.954598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 33/60] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:46.960492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca147ed-a3f7-480e-9940-c981af1ae7f0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:47.070203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca147ed-a3f7-480e-9940-c981af1ae7f0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:47.105032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f6e4f-e54c-42ed-9a50-f845bc71a57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:47.105700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f6e4f-e54c-42ed-9a50-f845bc71a57c None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:47.105984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f6e4f-e54c-42ed-9a50-f845bc71a57c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:47.106265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f6e4f-e54c-42ed-9a50-f845bc71a57c None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:47.106995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f6e4f-e54c-42ed-9a50-f845bc71a57c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:47.108480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f6e4f-e54c-42ed-9a50-f845bc71a57c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:47.139337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 28/61] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:16:46 2022] POST /identity/v3/users => generated 275 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:16:50.143973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4a129-f24a-4ecd-95f4-e63ea8ecb3db None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.145045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4a129-f24a-4ecd-95f4-e63ea8ecb3db None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.145521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4a129-f24a-4ecd-95f4-e63ea8ecb3db None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.147381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 34/62] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:50.152256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e15f7b-21c9-4ee9-8851-f2fe27ddaa84 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.153062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e15f7b-21c9-4ee9-8851-f2fe27ddaa84 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.153565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e15f7b-21c9-4ee9-8851-f2fe27ddaa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.174719 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-39e15f7b-21c9-4ee9-8851-f2fe27ddaa84 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:50.176225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-39e15f7b-21c9-4ee9-8851-f2fe27ddaa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:50.217858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:50.263203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 29/63] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:50.298543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4a129-f24a-4ecd-95f4-e63ea8ecb3db None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:50.416774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4a129-f24a-4ecd-95f4-e63ea8ecb3db None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:50.461202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad835d-8905-41eb-a397-ec82fe8f863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:50.462012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad835d-8905-41eb-a397-ec82fe8f863a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.462343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad835d-8905-41eb-a397-ec82fe8f863a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.462627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad835d-8905-41eb-a397-ec82fe8f863a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.470047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:50.471473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7a45-8032-4482-806f-db97a18cb4c9 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.471762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7a45-8032-4482-806f-db97a18cb4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.472055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c7a45-8032-4482-806f-db97a18cb4c9 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.481148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 30/64] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:50 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:50.481847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad835d-8905-41eb-a397-ec82fe8f863a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:50.486842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f6f1b-2d73-4841-9be1-0b59f0e75883 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.487128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f6f1b-2d73-4841-9be1-0b59f0e75883 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.487411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f6f1b-2d73-4841-9be1-0b59f0e75883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-78ad835d-8905-41eb-a397-ec82fe8f863a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:50.495731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:50.496604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:16:50.498087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 35/65] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:50.503763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58527770-c1dc-417a-b52c-0e0e24456a7e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.503763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58527770-c1dc-417a-b52c-0e0e24456a7e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.503763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58527770-c1dc-417a-b52c-0e0e24456a7e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.503763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 36/66] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:50.505359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58527770-c1dc-417a-b52c-0e0e24456a7e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:50.514136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b05f6f1b-2d73-4841-9be1-0b59f0e75883 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:50.515486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b05f6f1b-2d73-4841-9be1-0b59f0e75883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:50.612868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 31/67] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:50.612868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604e702-74ac-4a69-ad34-221cdd1b731d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.612868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604e702-74ac-4a69-ad34-221cdd1b731d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.612868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604e702-74ac-4a69-ad34-221cdd1b731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.626491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58527770-c1dc-417a-b52c-0e0e24456a7e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:50.629373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5604e702-74ac-4a69-ad34-221cdd1b731d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:50.631478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5604e702-74ac-4a69-ad34-221cdd1b731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:50.672418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a800d-2b3c-4da0-8707-cf8c5d364457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:50.673718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a800d-2b3c-4da0-8707-cf8c5d364457 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.674206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a800d-2b3c-4da0-8707-cf8c5d364457 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.674707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a800d-2b3c-4da0-8707-cf8c5d364457 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.675657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a800d-2b3c-4da0-8707-cf8c5d364457 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:50.676207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a800d-2b3c-4da0-8707-cf8c5d364457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:50.677822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a800d-2b3c-4da0-8707-cf8c5d364457 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:50.695219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 37/68] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:16:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:50.696560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a800d-2b3c-4da0-8707-cf8c5d364457 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:50.718805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 32/69] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:50.721657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604e702-74ac-4a69-ad34-221cdd1b731d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:50.767913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:50.784940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:50.842787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a800d-2b3c-4da0-8707-cf8c5d364457 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:50.844211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604e702-74ac-4a69-ad34-221cdd1b731d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:50.883632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52af70-71b4-43bc-b5e1-cb2d0bf105c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:50.885009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52af70-71b4-43bc-b5e1-cb2d0bf105c8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.885358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52af70-71b4-43bc-b5e1-cb2d0bf105c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.885639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52af70-71b4-43bc-b5e1-cb2d0bf105c8 None admin] PATH_INFO: `/v3/users/b6c16790bfc747a1a44c51bfa8616856` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.886733 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cdc90e-2798-40be-8dd8-eb05ad7bf431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:50.887723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdc90e-2798-40be-8dd8-eb05ad7bf431 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.888098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdc90e-2798-40be-8dd8-eb05ad7bf431 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.888942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cdc90e-2798-40be-8dd8-eb05ad7bf431 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.899946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cdc90e-2798-40be-8dd8-eb05ad7bf431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:50.901145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52af70-71b4-43bc-b5e1-cb2d0bf105c8 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c16790bfc747a1a44c51bfa8616856)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:50.902657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52af70-71b4-43bc-b5e1-cb2d0bf105c8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:50.909144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 33/70] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:50 2022] GET /identity/v3/users/b6c16790bfc747a1a44c51bfa8616856 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:50.909144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52af70-71b4-43bc-b5e1-cb2d0bf105c8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f9cdc90e-2798-40be-8dd8-eb05ad7bf431 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:50.909324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:50.910121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 38/71] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:16:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:50.910862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee864-6f0a-4f2d-a650-c1a3f112d4d6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:50.911546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee864-6f0a-4f2d-a650-c1a3f112d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:50.911546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ee864-6f0a-4f2d-a650-c1a3f112d4d6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:50.912783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 39/72] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:50.917262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ee864-6f0a-4f2d-a650-c1a3f112d4d6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.010896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:51.020967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52af70-71b4-43bc-b5e1-cb2d0bf105c8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.023997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ee864-6f0a-4f2d-a650-c1a3f112d4d6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.040855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:51.054166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825e94f-e1d4-4b16-9e8c-4b6c3984891d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.054971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825e94f-e1d4-4b16-9e8c-4b6c3984891d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.055516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825e94f-e1d4-4b16-9e8c-4b6c3984891d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.055792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825e94f-e1d4-4b16-9e8c-4b6c3984891d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.057077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f5fa0-94ac-4e8a-92ab-995846bc0f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.057729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f5fa0-94ac-4e8a-92ab-995846bc0f77 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.058009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f5fa0-94ac-4e8a-92ab-995846bc0f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.058285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f5fa0-94ac-4e8a-92ab-995846bc0f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.066238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825e94f-e1d4-4b16-9e8c-4b6c3984891d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e825e94f-e1d4-4b16-9e8c-4b6c3984891d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:51.073877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:51.074732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:16:51.075505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 34/73] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:51.076140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825e94f-e1d4-4b16-9e8c-4b6c3984891d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.125832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f5fa0-94ac-4e8a-92ab-995846bc0f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:51.127376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f5fa0-94ac-4e8a-92ab-995846bc0f77 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:51.177479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825e94f-e1d4-4b16-9e8c-4b6c3984891d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.210672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ebc16b-1b5e-4cff-8a0b-be11df34bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.211342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebc16b-1b5e-4cff-8a0b-be11df34bf0c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.211622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebc16b-1b5e-4cff-8a0b-be11df34bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.211903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebc16b-1b5e-4cff-8a0b-be11df34bf0c None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.212654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebc16b-1b5e-4cff-8a0b-be11df34bf0c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:51.212985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebc16b-1b5e-4cff-8a0b-be11df34bf0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:51.214366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ebc16b-1b5e-4cff-8a0b-be11df34bf0c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:51.224743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 35/74] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:16:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:51.226126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af35e86-d8e5-462e-a4a2-12b8f481cd72 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.226418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af35e86-d8e5-462e-a4a2-12b8f481cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.226695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af35e86-d8e5-462e-a4a2-12b8f481cd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.227069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 40/75] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:16:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:16:51.228307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849fcc-c702-4188-a953-3071d921486b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.228601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849fcc-c702-4188-a953-3071d921486b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.228905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b849fcc-c702-4188-a953-3071d921486b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.230272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 41/76] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:51.232979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849fcc-c702-4188-a953-3071d921486b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.249336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4af35e86-d8e5-462e-a4a2-12b8f481cd72 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:51.250546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4af35e86-d8e5-462e-a4a2-12b8f481cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:51.250735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:51.258893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:51.318762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 36/77] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:51.321793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af35e86-d8e5-462e-a4a2-12b8f481cd72 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.333601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b849fcc-c702-4188-a953-3071d921486b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.369423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8256de-abf0-4dab-b18a-0dc8d9023b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.370101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8256de-abf0-4dab-b18a-0dc8d9023b3e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.370390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8256de-abf0-4dab-b18a-0dc8d9023b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.370672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8256de-abf0-4dab-b18a-0dc8d9023b3e None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.371426 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8256de-abf0-4dab-b18a-0dc8d9023b3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:51.371737 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8256de-abf0-4dab-b18a-0dc8d9023b3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:51.373190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8256de-abf0-4dab-b18a-0dc8d9023b3e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:51.381383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 42/78] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:51.382186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8256de-abf0-4dab-b18a-0dc8d9023b3e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.430175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af35e86-d8e5-462e-a4a2-12b8f481cd72 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.461736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:51.464288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baec2c9-a0ee-4abd-9026-b54bdbab1789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.465336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baec2c9-a0ee-4abd-9026-b54bdbab1789 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.465619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baec2c9-a0ee-4abd-9026-b54bdbab1789 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.465894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baec2c9-a0ee-4abd-9026-b54bdbab1789 None admin] PATH_INFO: `/v3/users/b6c16790bfc747a1a44c51bfa8616856` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.467098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baec2c9-a0ee-4abd-9026-b54bdbab1789 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c16790bfc747a1a44c51bfa8616856)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:51.468566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baec2c9-a0ee-4abd-9026-b54bdbab1789 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:51.470286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 37/79] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:51 2022] GET /identity/v3/users/b6c16790bfc747a1a44c51bfa8616856 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:51.471512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d3f2c-80f3-4fdf-b887-07857b35935f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.471725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d3f2c-80f3-4fdf-b887-07857b35935f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.472013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d3f2c-80f3-4fdf-b887-07857b35935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.483156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8256de-abf0-4dab-b18a-0dc8d9023b3e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.488438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-965d3f2c-80f3-4fdf-b887-07857b35935f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:51.489664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-965d3f2c-80f3-4fdf-b887-07857b35935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:51.492720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:51.517575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66952d3c-3fb1-45ff-8bac-abf68a477fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.518451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66952d3c-3fb1-45ff-8bac-abf68a477fac None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.518734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66952d3c-3fb1-45ff-8bac-abf68a477fac None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.519009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66952d3c-3fb1-45ff-8bac-abf68a477fac None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.520191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66952d3c-3fb1-45ff-8bac-abf68a477fac None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:51.521694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66952d3c-3fb1-45ff-8bac-abf68a477fac None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:51.523398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 43/80] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:51 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:51.525717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66952d3c-3fb1-45ff-8bac-abf68a477fac None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.561106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 38/81] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:51.561943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d3f2c-80f3-4fdf-b887-07857b35935f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.631494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66952d3c-3fb1-45ff-8bac-abf68a477fac None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.668717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aa98e-a661-4c5b-aa61-014603b7ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.669554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aa98e-a661-4c5b-aa61-014603b7ea69 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.669839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aa98e-a661-4c5b-aa61-014603b7ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.670118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aa98e-a661-4c5b-aa61-014603b7ea69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.676989 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d3f2c-80f3-4fdf-b887-07857b35935f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.680258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aa98e-a661-4c5b-aa61-014603b7ea69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-330aa98e-a661-4c5b-aa61-014603b7ea69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:51.689203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:51.690356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 44/82] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:51.691472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aa98e-a661-4c5b-aa61-014603b7ea69 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.706120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:51.717877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dca96-0f85-4f18-af95-f7ec244ae537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.718903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dca96-0f85-4f18-af95-f7ec244ae537 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.719182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dca96-0f85-4f18-af95-f7ec244ae537 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.719451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dca96-0f85-4f18-af95-f7ec244ae537 None admin] PATH_INFO: `/v3/users/355fb13b7be647a8a84fa02e8179fe7a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.720872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dca96-0f85-4f18-af95-f7ec244ae537 None admin] RBAC: Authorizing `identity:get_user(user_id=355fb13b7be647a8a84fa02e8179fe7a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:51.722524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dca96-0f85-4f18-af95-f7ec244ae537 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:51.724187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 39/83] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:51 2022] GET /identity/v3/users/355fb13b7be647a8a84fa02e8179fe7a => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:51.724950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dca96-0f85-4f18-af95-f7ec244ae537 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.737551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:51.804066 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aa98e-a661-4c5b-aa61-014603b7ea69 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.834064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dca96-0f85-4f18-af95-f7ec244ae537 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:51.841020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928be94-57f2-4a1e-8630-5714b917ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.842104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928be94-57f2-4a1e-8630-5714b917ac26 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.842409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928be94-57f2-4a1e-8630-5714b917ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.842681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928be94-57f2-4a1e-8630-5714b917ac26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.871813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c67b7-c846-4472-b230-8009e06df02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:51.872487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c67b7-c846-4472-b230-8009e06df02a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:51.872787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c67b7-c846-4472-b230-8009e06df02a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:51.873087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c67b7-c846-4472-b230-8009e06df02a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:51.873931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c67b7-c846-4472-b230-8009e06df02a None admin] RBAC: Adding query filter params (role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24, user.id=b6c16790bfc747a1a44c51bfa8616856) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:51.874385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c67b7-c846-4472-b230-8009e06df02a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:51.877158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c67b7-c846-4472-b230-8009e06df02a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:51.883944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 40/84] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:16:51 2022] GET /identity/v3/role_assignments?user.id=b6c16790bfc747a1a44c51bfa8616856&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:51.884700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c67b7-c846-4472-b230-8009e06df02a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:51.919686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928be94-57f2-4a1e-8630-5714b917ac26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:51.921386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928be94-57f2-4a1e-8630-5714b917ac26 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:51.933690 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:51.979586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:52.017960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c67b7-c846-4472-b230-8009e06df02a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.044524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 45/85] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:16:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:16:52.046179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928be94-57f2-4a1e-8630-5714b917ac26 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:52.061872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54e379-6626-4fe3-aec0-e6289dc57a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:52.062904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54e379-6626-4fe3-aec0-e6289dc57a7b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:52.063253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54e379-6626-4fe3-aec0-e6289dc57a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:52.063737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54e379-6626-4fe3-aec0-e6289dc57a7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:52.065955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54e379-6626-4fe3-aec0-e6289dc57a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:52.067475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54e379-6626-4fe3-aec0-e6289dc57a7b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:52.073575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 41/86] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:52.073575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54e379-6626-4fe3-aec0-e6289dc57a7b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:52.164762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928be94-57f2-4a1e-8630-5714b917ac26 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.177602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:52.187918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54e379-6626-4fe3-aec0-e6289dc57a7b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.207245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78560eab-7e13-4b40-8acd-96a4fd238e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:52.207809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78560eab-7e13-4b40-8acd-96a4fd238e87 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:52.208093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78560eab-7e13-4b40-8acd-96a4fd238e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:52.208376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78560eab-7e13-4b40-8acd-96a4fd238e87 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:52.209601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78560eab-7e13-4b40-8acd-96a4fd238e87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:52.209916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78560eab-7e13-4b40-8acd-96a4fd238e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:52.211322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78560eab-7e13-4b40-8acd-96a4fd238e87 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:52.225002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 46/87] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:16:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:52.225002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78560eab-7e13-4b40-8acd-96a4fd238e87 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:52.231544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bfa18-311e-4b04-bb0a-b2e5bd7f8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:52.232241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bfa18-311e-4b04-bb0a-b2e5bd7f8571 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:52.232883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bfa18-311e-4b04-bb0a-b2e5bd7f8571 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:52.233217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bfa18-311e-4b04-bb0a-b2e5bd7f8571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:52.251656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:52.327557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78560eab-7e13-4b40-8acd-96a4fd238e87 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.328265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bfa18-311e-4b04-bb0a-b2e5bd7f8571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:52.329713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bfa18-311e-4b04-bb0a-b2e5bd7f8571 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:52.366983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c6cd6-0032-408c-82e3-b8d2aeea2930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:52.367865 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c6cd6-0032-408c-82e3-b8d2aeea2930 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:52.368151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c6cd6-0032-408c-82e3-b8d2aeea2930 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:52.368430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c6cd6-0032-408c-82e3-b8d2aeea2930 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:52.369793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c6cd6-0032-408c-82e3-b8d2aeea2930 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:52.371325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c6cd6-0032-408c-82e3-b8d2aeea2930 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:52.373130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 47/88] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:52 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:52.373900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c6cd6-0032-408c-82e3-b8d2aeea2930 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:52.416188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:52.451470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 42/89] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:16:52.452713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bfa18-311e-4b04-bb0a-b2e5bd7f8571 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:52.483562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c6cd6-0032-408c-82e3-b8d2aeea2930 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.505205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:52.528000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71e74a-37c0-4a21-9747-d709c811a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:52.529052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71e74a-37c0-4a21-9747-d709c811a706 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:52.529530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71e74a-37c0-4a21-9747-d709c811a706 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:52.529877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71e74a-37c0-4a21-9747-d709c811a706 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:52.530692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71e74a-37c0-4a21-9747-d709c811a706 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:52.532316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71e74a-37c0-4a21-9747-d709c811a706 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:52.572881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 48/90] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:16:52 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:16:52.572881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71e74a-37c0-4a21-9747-d709c811a706 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:52.586829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bfa18-311e-4b04-bb0a-b2e5bd7f8571 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.628658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19642096-d5a5-4275-94dc-a63abf894ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:52.629716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642096-d5a5-4275-94dc-a63abf894ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:52.630074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642096-d5a5-4275-94dc-a63abf894ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:52.630459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19642096-d5a5-4275-94dc-a63abf894ac5 None admin] PATH_INFO: `/v3/users/b6c16790bfc747a1a44c51bfa8616856` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:52.632219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19642096-d5a5-4275-94dc-a63abf894ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c16790bfc747a1a44c51bfa8616856)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:52.635235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19642096-d5a5-4275-94dc-a63abf894ac5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:52.637256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 43/91] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:52 2022] GET /identity/v3/users/b6c16790bfc747a1a44c51bfa8616856 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:52.638134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19642096-d5a5-4275-94dc-a63abf894ac5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:52.694356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:52.702596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71e74a-37c0-4a21-9747-d709c811a706 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.750000 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19642096-d5a5-4275-94dc-a63abf894ac5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.761144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:52.763036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518baf20-fb6b-43e8-b384-9d02cb436d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:52.764264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518baf20-fb6b-43e8-b384-9d02cb436d9c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:52.764716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518baf20-fb6b-43e8-b384-9d02cb436d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:52.765165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518baf20-fb6b-43e8-b384-9d02cb436d9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:52.766414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518baf20-fb6b-43e8-b384-9d02cb436d9c None admin] RBAC: Adding query filter params (role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24, user.id=b6c16790bfc747a1a44c51bfa8616856) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:52.767053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518baf20-fb6b-43e8-b384-9d02cb436d9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:52.769605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518baf20-fb6b-43e8-b384-9d02cb436d9c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:52.779691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 49/92] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:16:52 2022] GET /identity/v3/role_assignments?user.id=b6c16790bfc747a1a44c51bfa8616856&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:52.780761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518baf20-fb6b-43e8-b384-9d02cb436d9c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:52.797082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ecfb6-bb4a-4ddb-a2af-114f975bf656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:52.797989 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ecfb6-bb4a-4ddb-a2af-114f975bf656 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:52.798332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ecfb6-bb4a-4ddb-a2af-114f975bf656 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:52.798623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ecfb6-bb4a-4ddb-a2af-114f975bf656 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:52.799959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ecfb6-bb4a-4ddb-a2af-114f975bf656 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:52.801649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ecfb6-bb4a-4ddb-a2af-114f975bf656 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:52.803925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 44/93] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:52 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:52.809548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ecfb6-bb4a-4ddb-a2af-114f975bf656 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:52.928475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518baf20-fb6b-43e8-b384-9d02cb436d9c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.960401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ecfb6-bb4a-4ddb-a2af-114f975bf656 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:52.977536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238d57d-1733-4527-885a-2160f2303514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:52.978553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238d57d-1733-4527-885a-2160f2303514 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:52.979053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238d57d-1733-4527-885a-2160f2303514 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:52.979549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238d57d-1733-4527-885a-2160f2303514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:53.007986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c3a2-1f6f-44dd-81df-5708afe19dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:53.008954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c3a2-1f6f-44dd-81df-5708afe19dfd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:53.009245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c3a2-1f6f-44dd-81df-5708afe19dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:53.009526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80c3a2-1f6f-44dd-81df-5708afe19dfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:53.010747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:53.010922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c3a2-1f6f-44dd-81df-5708afe19dfd None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24, user.id=355fb13b7be647a8a84fa02e8179fe7a) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:53.011872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c3a2-1f6f-44dd-81df-5708afe19dfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:53.015004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80c3a2-1f6f-44dd-81df-5708afe19dfd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:53.025005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 45/94] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:16:52 2022] GET /identity/v3/role_assignments?user.id=355fb13b7be647a8a84fa02e8179fe7a&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=842af9e8967047df873d061df391e820 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:16:53.065342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238d57d-1733-4527-885a-2160f2303514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:53.067310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238d57d-1733-4527-885a-2160f2303514 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:53.181979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 50/95] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:16:53.187340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c3a2-1f6f-44dd-81df-5708afe19dfd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:53.240457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:53.307934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80c3a2-1f6f-44dd-81df-5708afe19dfd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:53.345813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c030ca-706a-4cf6-8230-bc132a19bbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:53.346700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c030ca-706a-4cf6-8230-bc132a19bbcb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:53.346981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c030ca-706a-4cf6-8230-bc132a19bbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:53.347257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c030ca-706a-4cf6-8230-bc132a19bbcb None admin] PATH_INFO: `/v3/projects/5247173b404f4de4bb980a7c51ce213e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:53.348470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c030ca-706a-4cf6-8230-bc132a19bbcb None admin] RBAC: Authorizing `identity:get_project(project_id=5247173b404f4de4bb980a7c51ce213e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:53.350003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c030ca-706a-4cf6-8230-bc132a19bbcb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:53.352067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 46/96] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:53 2022] GET /identity/v3/projects/5247173b404f4de4bb980a7c51ce213e => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:53.357951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238d57d-1733-4527-885a-2160f2303514 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:53.423968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:53.469727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238d57d-1733-4527-885a-2160f2303514 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:53.508003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfc562-a86e-4ff4-8b61-6df289f3e003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:53.508589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc562-a86e-4ff4-8b61-6df289f3e003 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:53.508896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc562-a86e-4ff4-8b61-6df289f3e003 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:53.509227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfc562-a86e-4ff4-8b61-6df289f3e003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:53.510119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfc562-a86e-4ff4-8b61-6df289f3e003 None admin] RBAC: Adding query filter params (role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=5247173b404f4de4bb980a7c51ce213e, user.id=b6c16790bfc747a1a44c51bfa8616856) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:53.510428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfc562-a86e-4ff4-8b61-6df289f3e003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:53.511912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfc562-a86e-4ff4-8b61-6df289f3e003 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:53.518363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 51/97] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:16:53 2022] GET /identity/v3/role_assignments?user.id=b6c16790bfc747a1a44c51bfa8616856&scope.project.id=5247173b404f4de4bb980a7c51ce213e&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:16:54.237686 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ef4e-11e3-410b-b330-94acc527237d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:54.238190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ef4e-11e3-410b-b330-94acc527237d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:54.238583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00ef4e-11e3-410b-b330-94acc527237d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:54.240322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 47/98] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:54.246048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ee48-e926-487b-bd71-cd421e9217f1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:54.246447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ee48-e926-487b-bd71-cd421e9217f1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:54.246828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ee48-e926-487b-bd71-cd421e9217f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:54.264384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d0a6ee48-e926-487b-bd71-cd421e9217f1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:54.265761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d0a6ee48-e926-487b-bd71-cd421e9217f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:54.349232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 52/99] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:16:54.384344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ef4e-11e3-410b-b330-94acc527237d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:54.501360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00ef4e-11e3-410b-b330-94acc527237d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:54.511267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:54.536293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c32a1-35dd-4bad-8d19-150560fd3750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:54.537140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c32a1-35dd-4bad-8d19-150560fd3750 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:54.537418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c32a1-35dd-4bad-8d19-150560fd3750 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:54.537690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c32a1-35dd-4bad-8d19-150560fd3750 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:54.549451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c32a1-35dd-4bad-8d19-150560fd3750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2e4c32a1-35dd-4bad-8d19-150560fd3750 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:54.557408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:54.558337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:16:54.559108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 48/100] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:54.565037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ee48-e926-487b-bd71-cd421e9217f1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:54.661352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:54.728781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ee48-e926-487b-bd71-cd421e9217f1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:54.821652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819571c-e717-4206-9fba-d0e9449d1b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:54.822263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819571c-e717-4206-9fba-d0e9449d1b47 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:54.822550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819571c-e717-4206-9fba-d0e9449d1b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:54.822831 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819571c-e717-4206-9fba-d0e9449d1b47 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:54.823607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819571c-e717-4206-9fba-d0e9449d1b47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:54.823919 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819571c-e717-4206-9fba-d0e9449d1b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:54.825372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819571c-e717-4206-9fba-d0e9449d1b47 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:54.839949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 53/101] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:16:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:54.849941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c32a1-35dd-4bad-8d19-150560fd3750 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:54.991647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c32a1-35dd-4bad-8d19-150560fd3750 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:55.035486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de95a3-dec0-4162-856d-75d626b25216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:55.036430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de95a3-dec0-4162-856d-75d626b25216 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:55.036716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de95a3-dec0-4162-856d-75d626b25216 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:55.037018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de95a3-dec0-4162-856d-75d626b25216 None admin] PATH_INFO: `/v3/users/b6c16790bfc747a1a44c51bfa8616856` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:55.041562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de95a3-dec0-4162-856d-75d626b25216 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c16790bfc747a1a44c51bfa8616856)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:55.043060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de95a3-dec0-4162-856d-75d626b25216 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:55.045051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 49/102] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:54 2022] GET /identity/v3/users/b6c16790bfc747a1a44c51bfa8616856 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:55.050611 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819571c-e717-4206-9fba-d0e9449d1b47 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:55.099167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e13de-8994-40ef-8e78-aa6416ff2fb5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:55.099461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e13de-8994-40ef-8e78-aa6416ff2fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:55.099744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e13de-8994-40ef-8e78-aa6416ff2fb5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:55.101584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 50/103] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:55.110501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f90c0-e001-467b-bfdb-cbf86b7f83be None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:55.110801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f90c0-e001-467b-bfdb-cbf86b7f83be None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:55.111068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f90c0-e001-467b-bfdb-cbf86b7f83be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:55.140146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-470f90c0-e001-467b-bfdb-cbf86b7f83be None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:55.142716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-470f90c0-e001-467b-bfdb-cbf86b7f83be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:55.209983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:55.229398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819571c-e717-4206-9fba-d0e9449d1b47 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:55.261283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:55.286802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 51/104] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:16:55.292872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb9397-2ace-440d-9308-22ee6965da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:55.294039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb9397-2ace-440d-9308-22ee6965da26 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:55.294549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb9397-2ace-440d-9308-22ee6965da26 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:55.295021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb9397-2ace-440d-9308-22ee6965da26 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:55.296521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb9397-2ace-440d-9308-22ee6965da26 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:55.298340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb9397-2ace-440d-9308-22ee6965da26 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:55.300280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 54/105] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:55 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:55.305980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f90c0-e001-467b-bfdb-cbf86b7f83be None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:55.327787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb9397-2ace-440d-9308-22ee6965da26 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:55.498632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f90c0-e001-467b-bfdb-cbf86b7f83be None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:55.526422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb9397-2ace-440d-9308-22ee6965da26 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:55.552246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc02c8-6b86-48d1-a44a-c36c797114de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:55.553528 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc02c8-6b86-48d1-a44a-c36c797114de None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:55.554058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc02c8-6b86-48d1-a44a-c36c797114de None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:55.554532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc02c8-6b86-48d1-a44a-c36c797114de None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/users/b6c16790bfc747a1a44c51bfa8616856/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:55.556727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc02c8-6b86-48d1-a44a-c36c797114de None admin] RBAC: Authorizing `identity:create_grant(project_id=b7ff669ba2a843c0aa02b2322f0cca24, user_id=b6c16790bfc747a1a44c51bfa8616856, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:55.558451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc02c8-6b86-48d1-a44a-c36c797114de None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:55.594656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82d07c-b46b-4515-bc85-52cf06e88af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:55.595496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82d07c-b46b-4515-bc85-52cf06e88af6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:55.595778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82d07c-b46b-4515-bc85-52cf06e88af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:55.596053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82d07c-b46b-4515-bc85-52cf06e88af6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:55.600255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 52/106] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:16:55 2022] PUT /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/users/b6c16790bfc747a1a44c51bfa8616856/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:16:55.611602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82d07c-b46b-4515-bc85-52cf06e88af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-2a82d07c-b46b-4515-bc85-52cf06e88af6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:55.620025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:55.621102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:16:55.621872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:16:55.622989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 55/107] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:16:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:16:55.628698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc02c8-6b86-48d1-a44a-c36c797114de None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:55.686884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:55.814270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc02c8-6b86-48d1-a44a-c36c797114de None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:55.862389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa38a46-7934-4923-9baf-c44ff3fcd21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:55.863098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa38a46-7934-4923-9baf-c44ff3fcd21f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:55.863383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa38a46-7934-4923-9baf-c44ff3fcd21f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:55.863659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa38a46-7934-4923-9baf-c44ff3fcd21f None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:55.864438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa38a46-7934-4923-9baf-c44ff3fcd21f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:55.864747 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa38a46-7934-4923-9baf-c44ff3fcd21f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:55.866185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa38a46-7934-4923-9baf-c44ff3fcd21f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:55.881287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 53/108] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:16:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:55.887266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82d07c-b46b-4515-bc85-52cf06e88af6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:55.956539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dad891-becf-4a7d-be3c-9f4460dd7ab1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:55.956873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dad891-becf-4a7d-be3c-9f4460dd7ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:55.957149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dad891-becf-4a7d-be3c-9f4460dd7ab1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:55.958812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 54/109] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:55.963853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298631e-8791-41e1-8265-acffe10617e2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:55.964143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298631e-8791-41e1-8265-acffe10617e2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:55.964427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298631e-8791-41e1-8265-acffe10617e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:55.980788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:55.983538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7298631e-8791-41e1-8265-acffe10617e2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:55.985356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7298631e-8791-41e1-8265-acffe10617e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:56.076376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 55/110] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:16:56.083064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82d07c-b46b-4515-bc85-52cf06e88af6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:56.126204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6690c-fd98-473e-a477-5884716a6b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:56.127404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6690c-fd98-473e-a477-5884716a6b85 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.127826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6690c-fd98-473e-a477-5884716a6b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.128235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6690c-fd98-473e-a477-5884716a6b85 None admin] PATH_INFO: `/v3/users/b6c16790bfc747a1a44c51bfa8616856` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.129611 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6690c-fd98-473e-a477-5884716a6b85 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c16790bfc747a1a44c51bfa8616856)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:56.131328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e6690c-fd98-473e-a477-5884716a6b85 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:56.133188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 56/111] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:55 2022] GET /identity/v3/users/b6c16790bfc747a1a44c51bfa8616856 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:56.138990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298631e-8791-41e1-8265-acffe10617e2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:56.153190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6690c-fd98-473e-a477-5884716a6b85 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:56.173224 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:56.308144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6690c-fd98-473e-a477-5884716a6b85 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:56.314446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298631e-8791-41e1-8265-acffe10617e2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:56.321319 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:56.350090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab3bff-bc03-4ede-92c9-3cd9f7b2e7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:56.351224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab3bff-bc03-4ede-92c9-3cd9f7b2e7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.351684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab3bff-bc03-4ede-92c9-3cd9f7b2e7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.351969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab3bff-bc03-4ede-92c9-3cd9f7b2e7b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.364164 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab3bff-bc03-4ede-92c9-3cd9f7b2e7b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8bab3bff-bc03-4ede-92c9-3cd9f7b2e7b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:56.373103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:56.374173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:16:56.375122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 57/112] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:16:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:56.375954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb737f00-30ab-4c59-b3c7-efc588bccfef None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.376028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb737f00-30ab-4c59-b3c7-efc588bccfef None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.376371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb737f00-30ab-4c59-b3c7-efc588bccfef None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.377979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 58/113] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:56.382301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb737f00-30ab-4c59-b3c7-efc588bccfef None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:56.416517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cece2-20a8-4b30-b791-cc8d4427949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:56.418470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cece2-20a8-4b30-b791-cc8d4427949c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.418755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cece2-20a8-4b30-b791-cc8d4427949c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.419031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cece2-20a8-4b30-b791-cc8d4427949c None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.420401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cece2-20a8-4b30-b791-cc8d4427949c None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:56.421913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cece2-20a8-4b30-b791-cc8d4427949c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:56.426340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 56/114] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:56 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:56.428294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f91d-592c-4d3c-a585-b5277ac94b40 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.428581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f91d-592c-4d3c-a585-b5277ac94b40 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.428877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939f91d-592c-4d3c-a585-b5277ac94b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.464018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9939f91d-592c-4d3c-a585-b5277ac94b40 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:56.466839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9939f91d-592c-4d3c-a585-b5277ac94b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:56.573231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb737f00-30ab-4c59-b3c7-efc588bccfef None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:56.573753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 57/115] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:56.574589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939f91d-592c-4d3c-a585-b5277ac94b40 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:56.594519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:56.658598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c799b42-d34d-49a2-9227-bc3cc5fe7419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:56.659240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c799b42-d34d-49a2-9227-bc3cc5fe7419 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.659472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c799b42-d34d-49a2-9227-bc3cc5fe7419 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.659748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c799b42-d34d-49a2-9227-bc3cc5fe7419 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.660506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c799b42-d34d-49a2-9227-bc3cc5fe7419 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:56.660817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c799b42-d34d-49a2-9227-bc3cc5fe7419 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:56.662261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c799b42-d34d-49a2-9227-bc3cc5fe7419 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:56.680001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 59/116] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:56.680711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c799b42-d34d-49a2-9227-bc3cc5fe7419 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:56.703455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939f91d-592c-4d3c-a585-b5277ac94b40 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:56.725132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:56.740548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd4e95-6a95-4544-846a-4ed17fdbe660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:56.741511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd4e95-6a95-4544-846a-4ed17fdbe660 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.742114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd4e95-6a95-4544-846a-4ed17fdbe660 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.742114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd4e95-6a95-4544-846a-4ed17fdbe660 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/users/b6c16790bfc747a1a44c51bfa8616856/roles/a97ad9c1458d4bf3a071884c10cae46c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.744409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd4e95-6a95-4544-846a-4ed17fdbe660 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7ff669ba2a843c0aa02b2322f0cca24, user_id=b6c16790bfc747a1a44c51bfa8616856, role_id=a97ad9c1458d4bf3a071884c10cae46c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:56.746055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd4e95-6a95-4544-846a-4ed17fdbe660 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:56.764939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 58/117] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:16:56 2022] PUT /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/users/b6c16790bfc747a1a44c51bfa8616856/roles/a97ad9c1458d4bf3a071884c10cae46c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:16:56.766933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765cad-0d11-4a04-9993-53fd6766e18b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.767849 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765cad-0d11-4a04-9993-53fd6766e18b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.768213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33765cad-0d11-4a04-9993-53fd6766e18b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.770180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 59/118] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:56.771293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765cad-0d11-4a04-9993-53fd6766e18b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:56.815538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c799b42-d34d-49a2-9227-bc3cc5fe7419 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:56.855031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb2186-f245-48ab-a197-e5e7df586f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:56.856532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb2186-f245-48ab-a197-e5e7df586f28 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.857034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb2186-f245-48ab-a197-e5e7df586f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.857639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb2186-f245-48ab-a197-e5e7df586f28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.874586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb2186-f245-48ab-a197-e5e7df586f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:56.880776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a4fb2186-f245-48ab-a197-e5e7df586f28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:56.885338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:56.886243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:16:56.887126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:16:56.889987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 60/119] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:56.891680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bf82-057c-4a2c-8b1e-46fd1c89fe9c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.892160 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bf82-057c-4a2c-8b1e-46fd1c89fe9c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.892591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42bf82-057c-4a2c-8b1e-46fd1c89fe9c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.894357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 61/120] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:56.895643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec97993-d8e6-4607-9bf4-e1af8105d221 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.896080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec97993-d8e6-4607-9bf4-e1af8105d221 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.896495 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec97993-d8e6-4607-9bf4-e1af8105d221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.918044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9ec97993-d8e6-4607-9bf4-e1af8105d221 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:56.919984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9ec97993-d8e6-4607-9bf4-e1af8105d221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:56.926164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33765cad-0d11-4a04-9993-53fd6766e18b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:56.970442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5609fa6-a682-483d-9422-a3b14fa98aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:56.971804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5609fa6-a682-483d-9422-a3b14fa98aba None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:56.972254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5609fa6-a682-483d-9422-a3b14fa98aba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:56.972670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5609fa6-a682-483d-9422-a3b14fa98aba None admin] PATH_INFO: `/v3/users/355fb13b7be647a8a84fa02e8179fe7a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:56.975023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5609fa6-a682-483d-9422-a3b14fa98aba None admin] RBAC: Authorizing `identity:get_user(user_id=355fb13b7be647a8a84fa02e8179fe7a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:56.976776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5609fa6-a682-483d-9422-a3b14fa98aba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:56.978867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 60/121] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:56 2022] GET /identity/v3/users/355fb13b7be647a8a84fa02e8179fe7a => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:56.979664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5609fa6-a682-483d-9422-a3b14fa98aba None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:57.011909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 62/122] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:57.017320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc11245-0e11-43c1-9514-56cb73bb0f03 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:57.017608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc11245-0e11-43c1-9514-56cb73bb0f03 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:57.017882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc11245-0e11-43c1-9514-56cb73bb0f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:57.047154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7dc11245-0e11-43c1-9514-56cb73bb0f03 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:57.048752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7dc11245-0e11-43c1-9514-56cb73bb0f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:57.069331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:57.129252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5609fa6-a682-483d-9422-a3b14fa98aba None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:57.132858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 63/123] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:57.133635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc11245-0e11-43c1-9514-56cb73bb0f03 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:57.171484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413950d2-c8d3-47b2-9dff-587d80d990e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:57.172261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413950d2-c8d3-47b2-9dff-587d80d990e0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:57.172559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413950d2-c8d3-47b2-9dff-587d80d990e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:57.172924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413950d2-c8d3-47b2-9dff-587d80d990e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:57.173864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413950d2-c8d3-47b2-9dff-587d80d990e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:57.174987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413950d2-c8d3-47b2-9dff-587d80d990e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:57.176525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413950d2-c8d3-47b2-9dff-587d80d990e0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:57.186987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 61/124] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:16:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:57.187848 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413950d2-c8d3-47b2-9dff-587d80d990e0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:57.201402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:57.252231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc11245-0e11-43c1-9514-56cb73bb0f03 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:57.286519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711697f-b3f7-4255-9b8c-01d532f57fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:57.287394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711697f-b3f7-4255-9b8c-01d532f57fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:57.287673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711697f-b3f7-4255-9b8c-01d532f57fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:57.287972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711697f-b3f7-4255-9b8c-01d532f57fc3 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:57.289178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711697f-b3f7-4255-9b8c-01d532f57fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:57.290670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711697f-b3f7-4255-9b8c-01d532f57fc3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:57.292392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 64/125] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:57 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:57.297523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711697f-b3f7-4255-9b8c-01d532f57fc3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:57.326055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413950d2-c8d3-47b2-9dff-587d80d990e0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:57.326915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:57.363095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b58de-c568-409f-8909-b70ce0a1134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:57.363965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b58de-c568-409f-8909-b70ce0a1134f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:57.364252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b58de-c568-409f-8909-b70ce0a1134f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:57.364530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b58de-c568-409f-8909-b70ce0a1134f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:57.375956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b58de-c568-409f-8909-b70ce0a1134f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cc7b58de-c568-409f-8909-b70ce0a1134f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:57.383941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:57.384788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:16:57.385583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 62/126] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:16:57.386675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b58de-c568-409f-8909-b70ce0a1134f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:57.431560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711697f-b3f7-4255-9b8c-01d532f57fc3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:57.456351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:57.481873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1720e-0684-4d80-a89b-204117f93ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:57.483377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1720e-0684-4d80-a89b-204117f93ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:57.483850 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1720e-0684-4d80-a89b-204117f93ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:57.484766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1720e-0684-4d80-a89b-204117f93ee5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:57.486312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1720e-0684-4d80-a89b-204117f93ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:57.488777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1720e-0684-4d80-a89b-204117f93ee5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:57.491405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 65/127] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:57.492618 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1720e-0684-4d80-a89b-204117f93ee5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:57.501301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b58de-c568-409f-8909-b70ce0a1134f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:57.537038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1ebd4-feb4-4964-a318-5534133ac122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:57.537933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1ebd4-feb4-4964-a318-5534133ac122 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:57.538219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1ebd4-feb4-4964-a318-5534133ac122 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:57.538497 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1ebd4-feb4-4964-a318-5534133ac122 None admin] PATH_INFO: `/v3/users/097236a9cec64ce0971c239c457816d7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:57.553795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1ebd4-feb4-4964-a318-5534133ac122 None admin] RBAC: Authorizing `identity:get_user(user_id=097236a9cec64ce0971c239c457816d7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:57.555275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1ebd4-feb4-4964-a318-5534133ac122 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:57.561633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 63/128] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:57 2022] GET /identity/v3/users/097236a9cec64ce0971c239c457816d7 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:57.561633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1ebd4-feb4-4964-a318-5534133ac122 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:57.603719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:57.622035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1720e-0684-4d80-a89b-204117f93ee5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:57.667153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad5749-33f3-457d-9d6a-46e3b37b9d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:57.669196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad5749-33f3-457d-9d6a-46e3b37b9d7b None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:57.670115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad5749-33f3-457d-9d6a-46e3b37b9d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:57.670532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad5749-33f3-457d-9d6a-46e3b37b9d7b None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/users/355fb13b7be647a8a84fa02e8179fe7a/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:57.673207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad5749-33f3-457d-9d6a-46e3b37b9d7b None admin] RBAC: Authorizing `identity:create_grant(project_id=b7ff669ba2a843c0aa02b2322f0cca24, user_id=355fb13b7be647a8a84fa02e8179fe7a, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:57.675645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad5749-33f3-457d-9d6a-46e3b37b9d7b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:57.693885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 66/129] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:16:57 2022] PUT /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/users/355fb13b7be647a8a84fa02e8179fe7a/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:16:57.701176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1ebd4-feb4-4964-a318-5534133ac122 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:57.701704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad5749-33f3-457d-9d6a-46e3b37b9d7b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:57.751332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:57.774480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d239-de66-4c5a-82de-060f96df0779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:57.775410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d239-de66-4c5a-82de-060f96df0779 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:57.775699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d239-de66-4c5a-82de-060f96df0779 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:57.775977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d239-de66-4c5a-82de-060f96df0779 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:57.778250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d239-de66-4c5a-82de-060f96df0779 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:57.778565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d239-de66-4c5a-82de-060f96df0779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:57.780012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d239-de66-4c5a-82de-060f96df0779 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:57.792880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 64/130] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:16:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:57.792880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d239-de66-4c5a-82de-060f96df0779 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:57.876442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad5749-33f3-457d-9d6a-46e3b37b9d7b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:57.918000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8370139-223f-409a-8382-f9a3f6a48957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:57.919233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8370139-223f-409a-8382-f9a3f6a48957 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:57.919706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8370139-223f-409a-8382-f9a3f6a48957 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:57.920169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8370139-223f-409a-8382-f9a3f6a48957 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:57.921117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8370139-223f-409a-8382-f9a3f6a48957 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:57.923186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8370139-223f-409a-8382-f9a3f6a48957 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:57.955470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:57.962477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 67/131] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:16:57 2022] POST /identity/v3/projects => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:16:57.964298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8370139-223f-409a-8382-f9a3f6a48957 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:58.039033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d239-de66-4c5a-82de-060f96df0779 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:58.105867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8370139-223f-409a-8382-f9a3f6a48957 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:58.145709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287d897-7a16-433a-9cf1-b3081939d836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:58.146979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d897-7a16-433a-9cf1-b3081939d836 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:58.147471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d897-7a16-433a-9cf1-b3081939d836 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:58.147932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d897-7a16-433a-9cf1-b3081939d836 None admin] PATH_INFO: `/v3/users/b6c16790bfc747a1a44c51bfa8616856` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:58.149605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287d897-7a16-433a-9cf1-b3081939d836 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c16790bfc747a1a44c51bfa8616856)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:58.151459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287d897-7a16-433a-9cf1-b3081939d836 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:58.153414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 68/132] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:57 2022] GET /identity/v3/users/b6c16790bfc747a1a44c51bfa8616856 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:58.159272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287d897-7a16-433a-9cf1-b3081939d836 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:58.165213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990165a1-46b5-4e86-80ed-f0139bb9ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:58.165898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990165a1-46b5-4e86-80ed-f0139bb9ff08 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:58.166189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990165a1-46b5-4e86-80ed-f0139bb9ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:58.166474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990165a1-46b5-4e86-80ed-f0139bb9ff08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:58.239311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:58.241050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:58.264084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990165a1-46b5-4e86-80ed-f0139bb9ff08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:58.265852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990165a1-46b5-4e86-80ed-f0139bb9ff08 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:58.292672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287d897-7a16-433a-9cf1-b3081939d836 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:58.332090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785820-88b3-494d-9218-55c6809c073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:58.333087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785820-88b3-494d-9218-55c6809c073a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:58.333456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785820-88b3-494d-9218-55c6809c073a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:58.333738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785820-88b3-494d-9218-55c6809c073a None admin] PATH_INFO: `/v3/projects/5247173b404f4de4bb980a7c51ce213e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:58.335049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75785820-88b3-494d-9218-55c6809c073a None admin] RBAC: Authorizing `identity:get_project(project_id=5247173b404f4de4bb980a7c51ce213e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:58.336524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75785820-88b3-494d-9218-55c6809c073a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:58.338605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 69/133] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:58 2022] GET /identity/v3/projects/5247173b404f4de4bb980a7c51ce213e => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:16:58.339712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8a29-cbad-489f-a1f4-f3f58d4570ad None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:58.339994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8a29-cbad-489f-a1f4-f3f58d4570ad None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:58.340275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae8a29-cbad-489f-a1f4-f3f58d4570ad None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:58.341524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 70/134] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:58.347907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8a29-cbad-489f-a1f4-f3f58d4570ad None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:58.429155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 65/135] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:16:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:16:58.430485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52793374-bee9-4a4f-8654-f2cdc2e401d7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:58.430781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52793374-bee9-4a4f-8654-f2cdc2e401d7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:58.431055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52793374-bee9-4a4f-8654-f2cdc2e401d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:58.466952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-52793374-bee9-4a4f-8654-f2cdc2e401d7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:58.468224 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-52793374-bee9-4a4f-8654-f2cdc2e401d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:58.518165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae8a29-cbad-489f-a1f4-f3f58d4570ad None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:58.556365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3446a-9d98-49ba-bf17-c632840a7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:58.557462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3446a-9d98-49ba-bf17-c632840a7772 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:58.557755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3446a-9d98-49ba-bf17-c632840a7772 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:58.558170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3446a-9d98-49ba-bf17-c632840a7772 None admin] PATH_INFO: `/v3/projects/5247173b404f4de4bb980a7c51ce213e/users/b6c16790bfc747a1a44c51bfa8616856/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:58.560277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3446a-9d98-49ba-bf17-c632840a7772 None admin] RBAC: Authorizing `identity:create_grant(project_id=5247173b404f4de4bb980a7c51ce213e, user_id=b6c16790bfc747a1a44c51bfa8616856, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:58.562056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3446a-9d98-49ba-bf17-c632840a7772 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:58.565593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:58.585519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 71/136] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:16:58 2022] PUT /identity/v3/projects/5247173b404f4de4bb980a7c51ce213e/users/b6c16790bfc747a1a44c51bfa8616856/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:16:58.586429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3446a-9d98-49ba-bf17-c632840a7772 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:58.595445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 66/137] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:58.635060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52793374-bee9-4a4f-8654-f2cdc2e401d7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:58.674292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:58.737416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3446a-9d98-49ba-bf17-c632840a7772 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:58.784306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f8e01-63fd-4806-b354-4919886ec209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:58.785627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f8e01-63fd-4806-b354-4919886ec209 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:58.785627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f8e01-63fd-4806-b354-4919886ec209 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:58.785842 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f8e01-63fd-4806-b354-4919886ec209 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:58.786896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f8e01-63fd-4806-b354-4919886ec209 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:58.788397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f8e01-63fd-4806-b354-4919886ec209 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:58.790175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 72/138] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:58 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:58.796337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f8e01-63fd-4806-b354-4919886ec209 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:58.840886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52793374-bee9-4a4f-8654-f2cdc2e401d7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:58.863907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:58.906560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f8e01-63fd-4806-b354-4919886ec209 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:58.907262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b927b1-8932-4ef9-b0cd-8965905b8406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:58.908291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b927b1-8932-4ef9-b0cd-8965905b8406 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:58.908714 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b927b1-8932-4ef9-b0cd-8965905b8406 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:58.909158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b927b1-8932-4ef9-b0cd-8965905b8406 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:58.930437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b927b1-8932-4ef9-b0cd-8965905b8406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:58.943004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d496322-2e10-479a-aba4-c58177ed089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:58.943682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d496322-2e10-479a-aba4-c58177ed089b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:58.943956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d496322-2e10-479a-aba4-c58177ed089b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:58.944236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d496322-2e10-479a-aba4-c58177ed089b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:58.945741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d496322-2e10-479a-aba4-c58177ed089b None admin] RBAC: Adding query filter params (role.id=554f851c7f784bbc9dc162466570cb20, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24, user.id=097236a9cec64ce0971c239c457816d7) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:58.946059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d496322-2e10-479a-aba4-c58177ed089b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-33b927b1-8932-4ef9-b0cd-8965905b8406 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:58.946332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:58.947323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:16:58.948289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:16:58.949017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d496322-2e10-479a-aba4-c58177ed089b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:58.954281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 67/139] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:16:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:16:58.954594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 73/140] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:16:58 2022] GET /identity/v3/role_assignments?user.id=097236a9cec64ce0971c239c457816d7&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=554f851c7f784bbc9dc162466570cb20 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:58.957915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b927b1-8932-4ef9-b0cd-8965905b8406 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:59.063452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:59.097510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b927b1-8932-4ef9-b0cd-8965905b8406 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:59.148805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c35e4-dd62-4e02-8fdc-10efe510c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:59.149666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c35e4-dd62-4e02-8fdc-10efe510c6bf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:59.149959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c35e4-dd62-4e02-8fdc-10efe510c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:59.150240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c35e4-dd62-4e02-8fdc-10efe510c6bf None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:59.151029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c35e4-dd62-4e02-8fdc-10efe510c6bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:16:59.151487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c35e4-dd62-4e02-8fdc-10efe510c6bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:59.152978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c35e4-dd62-4e02-8fdc-10efe510c6bf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:59.162762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 68/141] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:16:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:59.168101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d496322-2e10-479a-aba4-c58177ed089b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:59.240816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d2af8-4cf4-47f1-9975-960a4239294f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:59.241182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d2af8-4cf4-47f1-9975-960a4239294f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:59.241406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d2af8-4cf4-47f1-9975-960a4239294f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:59.243105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 69/142] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:16:59.248436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe2bd7-4be9-466e-b825-7c199d1e704c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:59.248729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe2bd7-4be9-466e-b825-7c199d1e704c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:59.249046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe2bd7-4be9-466e-b825-7c199d1e704c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:59.282970 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-33fe2bd7-4be9-466e-b825-7c199d1e704c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:16:59.284187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-33fe2bd7-4be9-466e-b825-7c199d1e704c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:16:59.334186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d496322-2e10-479a-aba4-c58177ed089b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:59.403067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:59.422737 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939a3ea-e06e-43e1-9cbf-8a12cee2762a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:59.423627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939a3ea-e06e-43e1-9cbf-8a12cee2762a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:59.423914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939a3ea-e06e-43e1-9cbf-8a12cee2762a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:59.424203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939a3ea-e06e-43e1-9cbf-8a12cee2762a None admin] PATH_INFO: `/v3/users/b6c16790bfc747a1a44c51bfa8616856` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:59.425461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939a3ea-e06e-43e1-9cbf-8a12cee2762a None admin] RBAC: Authorizing `identity:get_user(user_id=b6c16790bfc747a1a44c51bfa8616856)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:59.426933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939a3ea-e06e-43e1-9cbf-8a12cee2762a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:59.428598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 74/143] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:16:59 2022] GET /identity/v3/users/b6c16790bfc747a1a44c51bfa8616856 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:16:59.440250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939a3ea-e06e-43e1-9cbf-8a12cee2762a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:59.447343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 70/144] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:16:59.491727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe2bd7-4be9-466e-b825-7c199d1e704c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:59.621912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939a3ea-e06e-43e1-9cbf-8a12cee2762a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:59.633938 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:59.700598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe2bd7-4be9-466e-b825-7c199d1e704c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:16:59.709591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30cbfc-c832-49c1-a16c-c7962770b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:59.710274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30cbfc-c832-49c1-a16c-c7962770b70f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:59.710558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30cbfc-c832-49c1-a16c-c7962770b70f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:59.710831 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30cbfc-c832-49c1-a16c-c7962770b70f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:59.808242 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:16:59.818150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ac66a-e26a-4981-b62a-faef082010f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:16:59.818881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30cbfc-c832-49c1-a16c-c7962770b70f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:16:59.818989 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ac66a-e26a-4981-b62a-faef082010f7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:16:59.819262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ac66a-e26a-4981-b62a-faef082010f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:16:59.819541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ac66a-e26a-4981-b62a-faef082010f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:16:59.820480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30cbfc-c832-49c1-a16c-c7962770b70f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:16:59.847804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ac66a-e26a-4981-b62a-faef082010f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7e7ac66a-e26a-4981-b62a-faef082010f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:16:59.855959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:16:59.856828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:16:59.857632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:16:59.865434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 71/145] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:16:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:16:59.873863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ac66a-e26a-4981-b62a-faef082010f7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:16:59.924686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 75/146] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:16:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:16:59.930382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30cbfc-c832-49c1-a16c-c7962770b70f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:00.029294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:00.036788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30cbfc-c832-49c1-a16c-c7962770b70f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:00.073549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e35d-b5fe-4b4c-a011-55b8e14d3719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:00.074423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e35d-b5fe-4b4c-a011-55b8e14d3719 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:00.074703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e35d-b5fe-4b4c-a011-55b8e14d3719 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:00.074979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e35d-b5fe-4b4c-a011-55b8e14d3719 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:00.076166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657e35d-b5fe-4b4c-a011-55b8e14d3719 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:00.077697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d657e35d-b5fe-4b4c-a011-55b8e14d3719 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:00.079771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 76/147] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:16:59 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:00.085625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e35d-b5fe-4b4c-a011-55b8e14d3719 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:00.131075 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ac66a-e26a-4981-b62a-faef082010f7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:00.170721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:00.193428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab916-65b7-4cd6-94c2-82fc9062d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:00.194452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab916-65b7-4cd6-94c2-82fc9062d70d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:00.194983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab916-65b7-4cd6-94c2-82fc9062d70d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:00.195457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab916-65b7-4cd6-94c2-82fc9062d70d None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:00.196234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e35d-b5fe-4b4c-a011-55b8e14d3719 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:00.196635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab916-65b7-4cd6-94c2-82fc9062d70d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:00.197173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab916-65b7-4cd6-94c2-82fc9062d70d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:00.198796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab916-65b7-4cd6-94c2-82fc9062d70d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:00.216963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 72/148] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:16:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:00.218484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab916-65b7-4cd6-94c2-82fc9062d70d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:00.233345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0c8fd-10e5-4186-a3d9-4661ab8b863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:00.234009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0c8fd-10e5-4186-a3d9-4661ab8b863e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:00.234627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0c8fd-10e5-4186-a3d9-4661ab8b863e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:00.234942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0c8fd-10e5-4186-a3d9-4661ab8b863e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:00.235915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0c8fd-10e5-4186-a3d9-4661ab8b863e None admin] RBAC: Adding query filter params (role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24, user.id=b6c16790bfc747a1a44c51bfa8616856) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:00.236231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0c8fd-10e5-4186-a3d9-4661ab8b863e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:00.237838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0c8fd-10e5-4186-a3d9-4661ab8b863e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:00.250676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 77/149] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:00 2022] GET /identity/v3/role_assignments?user.id=b6c16790bfc747a1a44c51bfa8616856&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:00.329222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab916-65b7-4cd6-94c2-82fc9062d70d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:00.366955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765885f4-c972-44cf-bdd1-9cc292a384b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:00.368288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765885f4-c972-44cf-bdd1-9cc292a384b1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:00.368798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765885f4-c972-44cf-bdd1-9cc292a384b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:00.369338 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765885f4-c972-44cf-bdd1-9cc292a384b1 None admin] PATH_INFO: `/v3/users/b6c16790bfc747a1a44c51bfa8616856` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:00.370989 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765885f4-c972-44cf-bdd1-9cc292a384b1 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c16790bfc747a1a44c51bfa8616856)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:00.372789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765885f4-c972-44cf-bdd1-9cc292a384b1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:00.374777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 73/150] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:00 2022] GET /identity/v3/users/b6c16790bfc747a1a44c51bfa8616856 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:00.382968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0c8fd-10e5-4186-a3d9-4661ab8b863e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:00.431161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:00.528749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0c8fd-10e5-4186-a3d9-4661ab8b863e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:00.567028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d7a0-6b1c-46d5-bed1-27ac4403c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:00.567699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d7a0-6b1c-46d5-bed1-27ac4403c782 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:00.567982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d7a0-6b1c-46d5-bed1-27ac4403c782 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:00.568260 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d7a0-6b1c-46d5-bed1-27ac4403c782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:00.639513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d7a0-6b1c-46d5-bed1-27ac4403c782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:00.640957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d7a0-6b1c-46d5-bed1-27ac4403c782 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:00.669177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:00.744963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 78/151] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:00.751472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765885f4-c972-44cf-bdd1-9cc292a384b1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:00.759486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d299d74-10c9-4838-bbbd-65f87e515a6f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:00.759952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d299d74-10c9-4838-bbbd-65f87e515a6f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:00.760165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d299d74-10c9-4838-bbbd-65f87e515a6f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:00.761901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 79/152] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:00.767109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692d038-78f1-45a5-a0bc-279215579510 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:00.767396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692d038-78f1-45a5-a0bc-279215579510 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:00.767665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692d038-78f1-45a5-a0bc-279215579510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:00.785993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f692d038-78f1-45a5-a0bc-279215579510 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:00.787190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f692d038-78f1-45a5-a0bc-279215579510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:00.873901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:00.890377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 80/153] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:00.926627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765885f4-c972-44cf-bdd1-9cc292a384b1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:00.931165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692d038-78f1-45a5-a0bc-279215579510 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:01.002189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bafcf-46bd-4fc3-927c-bb3fffe913a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:01.003086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bafcf-46bd-4fc3-927c-bb3fffe913a1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.003367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bafcf-46bd-4fc3-927c-bb3fffe913a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.003651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bafcf-46bd-4fc3-927c-bb3fffe913a1 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.006052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bafcf-46bd-4fc3-927c-bb3fffe913a1 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:01.007530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bafcf-46bd-4fc3-927c-bb3fffe913a1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:01.009305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 74/154] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:00 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:01.017021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bafcf-46bd-4fc3-927c-bb3fffe913a1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:01.034520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:01.086826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692d038-78f1-45a5-a0bc-279215579510 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:01.127969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bafcf-46bd-4fc3-927c-bb3fffe913a1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:01.129972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d00c0-d2be-4cf8-a6f0-e883c4c0ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:01.131726 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d00c0-d2be-4cf8-a6f0-e883c4c0ec07 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.132159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d00c0-d2be-4cf8-a6f0-e883c4c0ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.132579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d00c0-d2be-4cf8-a6f0-e883c4c0ec07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.145245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d00c0-d2be-4cf8-a6f0-e883c4c0ec07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-072d00c0-d2be-4cf8-a6f0-e883c4c0ec07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:01.155002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:01.156314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:01.157509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:01.159839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 81/155] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:01.160240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:01.161721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b83f2-f979-498c-88fe-425d73611229 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.162459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b83f2-f979-498c-88fe-425d73611229 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.163339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b83f2-f979-498c-88fe-425d73611229 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.164511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 82/156] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:01.169868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b83f2-f979-498c-88fe-425d73611229 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:01.174734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181bec8-c20a-484f-acc8-2320800c1802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:01.175738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181bec8-c20a-484f-acc8-2320800c1802 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.176252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181bec8-c20a-484f-acc8-2320800c1802 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.176753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181bec8-c20a-484f-acc8-2320800c1802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.177826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181bec8-c20a-484f-acc8-2320800c1802 None admin] RBAC: Adding query filter params (role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24, user.id=b6c16790bfc747a1a44c51bfa8616856) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:01.178354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181bec8-c20a-484f-acc8-2320800c1802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:01.180177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181bec8-c20a-484f-acc8-2320800c1802 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:01.187012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 75/157] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:01 2022] GET /identity/v3/role_assignments?user.id=b6c16790bfc747a1a44c51bfa8616856&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:01.188800 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5326b1-f7a7-4aa0-91fb-9d90bdbd4386 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.189332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5326b1-f7a7-4aa0-91fb-9d90bdbd4386 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.189876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5326b1-f7a7-4aa0-91fb-9d90bdbd4386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.208963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ba5326b1-f7a7-4aa0-91fb-9d90bdbd4386 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:01.210535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ba5326b1-f7a7-4aa0-91fb-9d90bdbd4386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:01.341513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 76/158] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:01.356143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b83f2-f979-498c-88fe-425d73611229 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:01.373264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5326b1-f7a7-4aa0-91fb-9d90bdbd4386 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:01.376134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:01.400953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833c4fe-d8c1-4dc7-b037-d1b5fa602330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:01.401834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833c4fe-d8c1-4dc7-b037-d1b5fa602330 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.401954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833c4fe-d8c1-4dc7-b037-d1b5fa602330 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.402213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833c4fe-d8c1-4dc7-b037-d1b5fa602330 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.402972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833c4fe-d8c1-4dc7-b037-d1b5fa602330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:01.403279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833c4fe-d8c1-4dc7-b037-d1b5fa602330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:01.404741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833c4fe-d8c1-4dc7-b037-d1b5fa602330 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:01.414513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 83/159] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:01.420132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833c4fe-d8c1-4dc7-b037-d1b5fa602330 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:01.491178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5326b1-f7a7-4aa0-91fb-9d90bdbd4386 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:01.514845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:01.524875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833c4fe-d8c1-4dc7-b037-d1b5fa602330 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:01.537373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb0d7c-55d2-433d-87cb-eb11f54562b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:01.538544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb0d7c-55d2-433d-87cb-eb11f54562b6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.539029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb0d7c-55d2-433d-87cb-eb11f54562b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.539495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb0d7c-55d2-433d-87cb-eb11f54562b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.541880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb0d7c-55d2-433d-87cb-eb11f54562b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:01.543778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb0d7c-55d2-433d-87cb-eb11f54562b6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:01.547576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 77/160] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:01.561861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb0d7c-55d2-433d-87cb-eb11f54562b6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:01.607566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dae991-2ca0-4231-b9d0-92f4ad980a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:01.609495 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dae991-2ca0-4231-b9d0-92f4ad980a86 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.610005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dae991-2ca0-4231-b9d0-92f4ad980a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.610420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dae991-2ca0-4231-b9d0-92f4ad980a86 None admin] PATH_INFO: `/v3/users/355fb13b7be647a8a84fa02e8179fe7a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.614683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dae991-2ca0-4231-b9d0-92f4ad980a86 None admin] RBAC: Authorizing `identity:get_user(user_id=355fb13b7be647a8a84fa02e8179fe7a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:01.616468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dae991-2ca0-4231-b9d0-92f4ad980a86 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:01.618805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 84/161] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:01 2022] GET /identity/v3/users/355fb13b7be647a8a84fa02e8179fe7a => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:01.626360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dae991-2ca0-4231-b9d0-92f4ad980a86 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:01.678129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb0d7c-55d2-433d-87cb-eb11f54562b6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:01.689773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:01.714065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a751f18-4c4c-473d-a402-07ef3401e0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:01.714747 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a751f18-4c4c-473d-a402-07ef3401e0ec None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.715027 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a751f18-4c4c-473d-a402-07ef3401e0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.715301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a751f18-4c4c-473d-a402-07ef3401e0ec None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.716035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a751f18-4c4c-473d-a402-07ef3401e0ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:01.717536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a751f18-4c4c-473d-a402-07ef3401e0ec None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:01.748890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 78/162] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:01 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:01.748890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02b86-6cab-4fd8-acac-e1dcbe90e5d8 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.748890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02b86-6cab-4fd8-acac-e1dcbe90e5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.748890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e02b86-6cab-4fd8-acac-e1dcbe90e5d8 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.748890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 79/163] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:01.748890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd1950-7caf-4feb-a860-18532120d95a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.748890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd1950-7caf-4feb-a860-18532120d95a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.749953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd1950-7caf-4feb-a860-18532120d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.766930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dae991-2ca0-4231-b9d0-92f4ad980a86 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:01.774723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-88bd1950-7caf-4feb-a860-18532120d95a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:01.775969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-88bd1950-7caf-4feb-a860-18532120d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:01.815372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0289ef-84eb-49e8-8451-e307903f7db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:01.817587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0289ef-84eb-49e8-8451-e307903f7db5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:01.818226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0289ef-84eb-49e8-8451-e307903f7db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:01.818711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0289ef-84eb-49e8-8451-e307903f7db5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:01.822066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:01.860545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 80/164] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:01.888019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd1950-7caf-4feb-a860-18532120d95a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:01.913952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0289ef-84eb-49e8-8451-e307903f7db5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:01.915534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0289ef-84eb-49e8-8451-e307903f7db5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:01.977025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:02.016351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd1950-7caf-4feb-a860-18532120d95a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:02.035740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 85/165] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:02.040869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec88c98-a65c-40be-91c9-69796b301dd2 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.040869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec88c98-a65c-40be-91c9-69796b301dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.040869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec88c98-a65c-40be-91c9-69796b301dd2 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.040869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 86/166] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:02.044224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec88c98-a65c-40be-91c9-69796b301dd2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:02.069820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d46b3-dd0f-44a0-9563-ac620e9524d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:02.071026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d46b3-dd0f-44a0-9563-ac620e9524d1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.071519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d46b3-dd0f-44a0-9563-ac620e9524d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.071984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d46b3-dd0f-44a0-9563-ac620e9524d1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.087084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d46b3-dd0f-44a0-9563-ac620e9524d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-362d46b3-dd0f-44a0-9563-ac620e9524d1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:02.095260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:02.096173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:02.097337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 81/167] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:02.098049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ad566-db84-418a-aca5-e672b7cad8bd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.098049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ad566-db84-418a-aca5-e672b7cad8bd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.098455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ad566-db84-418a-aca5-e672b7cad8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.118682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-256ad566-db84-418a-aca5-e672b7cad8bd None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:02.120787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-256ad566-db84-418a-aca5-e672b7cad8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:02.151496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:02.178817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec88c98-a65c-40be-91c9-69796b301dd2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:02.202232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 82/168] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:02.203540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ad566-db84-418a-aca5-e672b7cad8bd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:02.221185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b367db1-03cd-4373-974f-850db3a1c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:02.222147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b367db1-03cd-4373-974f-850db3a1c686 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.222428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b367db1-03cd-4373-974f-850db3a1c686 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.222702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b367db1-03cd-4373-974f-850db3a1c686 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.223994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b367db1-03cd-4373-974f-850db3a1c686 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:02.225627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b367db1-03cd-4373-974f-850db3a1c686 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:02.227794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 87/169] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:02 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:02.233761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b367db1-03cd-4373-974f-850db3a1c686 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:02.259210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:02.320139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ad566-db84-418a-aca5-e672b7cad8bd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:02.356946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b367db1-03cd-4373-974f-850db3a1c686 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:02.361690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f06d5-7204-4f47-93e0-58fe07d3f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:02.362381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f06d5-7204-4f47-93e0-58fe07d3f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.362669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f06d5-7204-4f47-93e0-58fe07d3f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.362938 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f06d5-7204-4f47-93e0-58fe07d3f1a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.363700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f06d5-7204-4f47-93e0-58fe07d3f1a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:02.364006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f06d5-7204-4f47-93e0-58fe07d3f1a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:02.365900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f06d5-7204-4f47-93e0-58fe07d3f1a5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:02.377313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 83/170] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:02.377960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f06d5-7204-4f47-93e0-58fe07d3f1a5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:02.394783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706836c-2230-466a-922f-688fd86324fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:02.395454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706836c-2230-466a-922f-688fd86324fd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.395736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706836c-2230-466a-922f-688fd86324fd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.396041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706836c-2230-466a-922f-688fd86324fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.396913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706836c-2230-466a-922f-688fd86324fd None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24, user.id=355fb13b7be647a8a84fa02e8179fe7a) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:02.397222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706836c-2230-466a-922f-688fd86324fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:02.398687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706836c-2230-466a-922f-688fd86324fd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:02.406061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 88/171] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:02 2022] GET /identity/v3/role_assignments?user.id=355fb13b7be647a8a84fa02e8179fe7a&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=842af9e8967047df873d061df391e820 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:02.406937 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706836c-2230-466a-922f-688fd86324fd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:02.414298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:02.578176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:02.580043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f06d5-7204-4f47-93e0-58fe07d3f1a5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:02.601076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706836c-2230-466a-922f-688fd86324fd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:02.642440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a6639-7d87-485f-bcd6-b58dde03a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:02.643340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a6639-7d87-485f-bcd6-b58dde03a346 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.643849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a6639-7d87-485f-bcd6-b58dde03a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.644128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a6639-7d87-485f-bcd6-b58dde03a346 None admin] PATH_INFO: `/v3/users/b6c16790bfc747a1a44c51bfa8616856` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.646673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a6639-7d87-485f-bcd6-b58dde03a346 None admin] RBAC: Authorizing `identity:get_user(user_id=b6c16790bfc747a1a44c51bfa8616856)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:02.648152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a6639-7d87-485f-bcd6-b58dde03a346 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:02.649844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 89/172] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:02 2022] GET /identity/v3/users/b6c16790bfc747a1a44c51bfa8616856 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:02.656953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a6639-7d87-485f-bcd6-b58dde03a346 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:02.670293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5967c88-bd18-427d-a308-c864767c199c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:02.671169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5967c88-bd18-427d-a308-c864767c199c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.671450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5967c88-bd18-427d-a308-c864767c199c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.671723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5967c88-bd18-427d-a308-c864767c199c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.692098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5967c88-bd18-427d-a308-c864767c199c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a5967c88-bd18-427d-a308-c864767c199c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:02.707089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:02.708053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:02.709383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 84/173] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:02.716366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5967c88-bd18-427d-a308-c864767c199c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:02.785473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a6639-7d87-485f-bcd6-b58dde03a346 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:02.826179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e2db-9eaf-4d1b-8293-5591c1220916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:02.826844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e2db-9eaf-4d1b-8293-5591c1220916 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.827121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e2db-9eaf-4d1b-8293-5591c1220916 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.827393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05e2db-9eaf-4d1b-8293-5591c1220916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.854545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:02.900584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:02.919536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05e2db-9eaf-4d1b-8293-5591c1220916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:02.920713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5967c88-bd18-427d-a308-c864767c199c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:02.921051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05e2db-9eaf-4d1b-8293-5591c1220916 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:02.961044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790578e-23f3-45e2-8ce4-e5ca994f0d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:02.962093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790578e-23f3-45e2-8ce4-e5ca994f0d23 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:02.962592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790578e-23f3-45e2-8ce4-e5ca994f0d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:02.963153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790578e-23f3-45e2-8ce4-e5ca994f0d23 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:02.964226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790578e-23f3-45e2-8ce4-e5ca994f0d23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:02.964732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790578e-23f3-45e2-8ce4-e5ca994f0d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:02.966373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790578e-23f3-45e2-8ce4-e5ca994f0d23 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:02.976065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 85/174] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:02.982543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790578e-23f3-45e2-8ce4-e5ca994f0d23 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:03.038053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 90/175] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:03.050613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e2db-9eaf-4d1b-8293-5591c1220916 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:03.096655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790578e-23f3-45e2-8ce4-e5ca994f0d23 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:03.132071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a335f0-12f6-4ac1-82ee-b252f37d8e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:03.132927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a335f0-12f6-4ac1-82ee-b252f37d8e5c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:03.133217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a335f0-12f6-4ac1-82ee-b252f37d8e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:03.133582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a335f0-12f6-4ac1-82ee-b252f37d8e5c None admin] PATH_INFO: `/v3/users/097236a9cec64ce0971c239c457816d7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:03.134720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a335f0-12f6-4ac1-82ee-b252f37d8e5c None admin] RBAC: Authorizing `identity:get_user(user_id=097236a9cec64ce0971c239c457816d7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:03.136228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a335f0-12f6-4ac1-82ee-b252f37d8e5c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:03.142580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 86/176] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:02 2022] GET /identity/v3/users/097236a9cec64ce0971c239c457816d7 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:03.144613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a335f0-12f6-4ac1-82ee-b252f37d8e5c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:03.171362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:03.182656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:03.263776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05e2db-9eaf-4d1b-8293-5591c1220916 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:03.306663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d36bb-8f3c-4bc4-bfb2-ffd9d8804942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:03.307991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d36bb-8f3c-4bc4-bfb2-ffd9d8804942 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:03.308557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d36bb-8f3c-4bc4-bfb2-ffd9d8804942 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:03.309191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d36bb-8f3c-4bc4-bfb2-ffd9d8804942 None admin] PATH_INFO: `/v3/projects/5247173b404f4de4bb980a7c51ce213e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:03.310397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d36bb-8f3c-4bc4-bfb2-ffd9d8804942 None admin] RBAC: Authorizing `identity:get_project(project_id=5247173b404f4de4bb980a7c51ce213e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:03.311968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d36bb-8f3c-4bc4-bfb2-ffd9d8804942 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:03.312496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a335f0-12f6-4ac1-82ee-b252f37d8e5c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:03.313741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 91/177] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:03 2022] GET /identity/v3/projects/5247173b404f4de4bb980a7c51ce213e => generated 312 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:03.324379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d36bb-8f3c-4bc4-bfb2-ffd9d8804942 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:03.373708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74361eea-09c9-4f15-b1a5-dba636792452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:03.374982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74361eea-09c9-4f15-b1a5-dba636792452 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:03.375525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74361eea-09c9-4f15-b1a5-dba636792452 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:03.375999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74361eea-09c9-4f15-b1a5-dba636792452 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:03.378105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74361eea-09c9-4f15-b1a5-dba636792452 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:03.379937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74361eea-09c9-4f15-b1a5-dba636792452 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:03.384482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 87/178] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:03 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:03.392463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74361eea-09c9-4f15-b1a5-dba636792452 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:03.514252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d36bb-8f3c-4bc4-bfb2-ffd9d8804942 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:03.546627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:03.560445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:03.581252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee961a-2165-46ab-9555-9854d3cbb25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:03.582754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee961a-2165-46ab-9555-9854d3cbb25b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:03.584625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee961a-2165-46ab-9555-9854d3cbb25b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:03.585136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee961a-2165-46ab-9555-9854d3cbb25b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:03.587179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee961a-2165-46ab-9555-9854d3cbb25b None admin] RBAC: Adding query filter params (role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=5247173b404f4de4bb980a7c51ce213e, user.id=b6c16790bfc747a1a44c51bfa8616856) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:03.587769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee961a-2165-46ab-9555-9854d3cbb25b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:03.590121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee961a-2165-46ab-9555-9854d3cbb25b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:03.592376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74361eea-09c9-4f15-b1a5-dba636792452 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:03.610987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 92/179] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:03 2022] GET /identity/v3/role_assignments?user.id=b6c16790bfc747a1a44c51bfa8616856&scope.project.id=5247173b404f4de4bb980a7c51ce213e&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:03.648816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06bc5b-4b01-409a-a95c-056d1693302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:03.650322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06bc5b-4b01-409a-a95c-056d1693302e None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:03.651139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06bc5b-4b01-409a-a95c-056d1693302e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:03.651924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06bc5b-4b01-409a-a95c-056d1693302e None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/users/097236a9cec64ce0971c239c457816d7/roles/554f851c7f784bbc9dc162466570cb20` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:03.654628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06bc5b-4b01-409a-a95c-056d1693302e None admin] RBAC: Authorizing `identity:create_grant(project_id=b7ff669ba2a843c0aa02b2322f0cca24, user_id=097236a9cec64ce0971c239c457816d7, role_id=554f851c7f784bbc9dc162466570cb20)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:03.656510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06bc5b-4b01-409a-a95c-056d1693302e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:03.681683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 88/180] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:03 2022] PUT /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/users/097236a9cec64ce0971c239c457816d7/roles/554f851c7f784bbc9dc162466570cb20 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:17:04.239065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e4141-da4f-401f-aae7-3a87b917121b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.239585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e4141-da4f-401f-aae7-3a87b917121b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.239661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e4141-da4f-401f-aae7-3a87b917121b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.241342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 93/181] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:04.246556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9af5c-aa44-48d6-a3fa-d8db6d5616a0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.247387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9af5c-aa44-48d6-a3fa-d8db6d5616a0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.247873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9af5c-aa44-48d6-a3fa-d8db6d5616a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.266440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f2e9af5c-aa44-48d6-a3fa-d8db6d5616a0 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:04.268026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f2e9af5c-aa44-48d6-a3fa-d8db6d5616a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:04.345799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 89/182] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:04.369451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e4141-da4f-401f-aae7-3a87b917121b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:04.471927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e4141-da4f-401f-aae7-3a87b917121b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:04.508155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad18167-3bc9-437a-a0a6-2e41d23a423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:04.508895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad18167-3bc9-437a-a0a6-2e41d23a423f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.509184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad18167-3bc9-437a-a0a6-2e41d23a423f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.509457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad18167-3bc9-437a-a0a6-2e41d23a423f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.520399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad18167-3bc9-437a-a0a6-2e41d23a423f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-6ad18167-3bc9-437a-a0a6-2e41d23a423f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:04.528143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:04.529079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:04.529849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 94/183] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:17:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:04.535424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9af5c-aa44-48d6-a3fa-d8db6d5616a0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:04.587878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33c806-7e1d-4db6-852c-b990317c53c3 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.588202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33c806-7e1d-4db6-852c-b990317c53c3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.588764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33c806-7e1d-4db6-852c-b990317c53c3 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.590371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 95/184] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:04.595578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734edfca-719e-46f0-a589-93e6ff34ec69 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.595865 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734edfca-719e-46f0-a589-93e6ff34ec69 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.596146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734edfca-719e-46f0-a589-93e6ff34ec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.614865 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-734edfca-719e-46f0-a589-93e6ff34ec69 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:04.616177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-734edfca-719e-46f0-a589-93e6ff34ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:04.623275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:04.653972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9af5c-aa44-48d6-a3fa-d8db6d5616a0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:04.658518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:04.689977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70339f-43dd-4d86-9e2a-a5fa8d407ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:04.690763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70339f-43dd-4d86-9e2a-a5fa8d407ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.690981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70339f-43dd-4d86-9e2a-a5fa8d407ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.691316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70339f-43dd-4d86-9e2a-a5fa8d407ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.691988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70339f-43dd-4d86-9e2a-a5fa8d407ff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:04.692295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70339f-43dd-4d86-9e2a-a5fa8d407ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:04.692592 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 96/185] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:04.694242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70339f-43dd-4d86-9e2a-a5fa8d407ff0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:04.698314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636474-bf15-4ce8-a587-b801ccdf7b1d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.698825 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636474-bf15-4ce8-a587-b801ccdf7b1d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.699397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636474-bf15-4ce8-a587-b801ccdf7b1d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.705075 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 90/186] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:04.705907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 97/187] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:04 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:04.706553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929fdeb-57a5-471d-8a84-414b246a1cc7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.706838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929fdeb-57a5-471d-8a84-414b246a1cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.707241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929fdeb-57a5-471d-8a84-414b246a1cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.708187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636474-bf15-4ce8-a587-b801ccdf7b1d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:04.723988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3929fdeb-57a5-471d-8a84-414b246a1cc7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:04.725241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3929fdeb-57a5-471d-8a84-414b246a1cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:04.804968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 91/188] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:04.804968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929fdeb-57a5-471d-8a84-414b246a1cc7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:04.829161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636474-bf15-4ce8-a587-b801ccdf7b1d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:04.865154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828886e5-d7ba-4c1c-97e0-fcc913bdce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:04.866056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828886e5-d7ba-4c1c-97e0-fcc913bdce0f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.866338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828886e5-d7ba-4c1c-97e0-fcc913bdce0f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.866611 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828886e5-d7ba-4c1c-97e0-fcc913bdce0f None admin] PATH_INFO: `/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.874593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:04.883068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828886e5-d7ba-4c1c-97e0-fcc913bdce0f None admin] RBAC: Authorizing `identity:get_user(user_id=25c6dded5d8c4df8bb5a43f8f7f54677)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:04.884526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828886e5-d7ba-4c1c-97e0-fcc913bdce0f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:04.886324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 98/189] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:04 2022] GET /identity/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:04.887097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828886e5-d7ba-4c1c-97e0-fcc913bdce0f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:04.914456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929fdeb-57a5-471d-8a84-414b246a1cc7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:04.919876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:04.950919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369d472-0de0-4ba7-bf98-a64aa4a261b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:04.951869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369d472-0de0-4ba7-bf98-a64aa4a261b6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:04.951988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369d472-0de0-4ba7-bf98-a64aa4a261b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:04.952281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369d472-0de0-4ba7-bf98-a64aa4a261b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:04.963294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369d472-0de0-4ba7-bf98-a64aa4a261b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a369d472-0de0-4ba7-bf98-a64aa4a261b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:04.971535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:04.972435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:04.973266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 92/190] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:04.973923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369d472-0de0-4ba7-bf98-a64aa4a261b6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:05.005398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828886e5-d7ba-4c1c-97e0-fcc913bdce0f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:05.043252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45ab1-1efa-4a8e-b380-a1a9b4effcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:05.044065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45ab1-1efa-4a8e-b380-a1a9b4effcba None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.044348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45ab1-1efa-4a8e-b380-a1a9b4effcba None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.044624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45ab1-1efa-4a8e-b380-a1a9b4effcba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.045824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45ab1-1efa-4a8e-b380-a1a9b4effcba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:05.047312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45ab1-1efa-4a8e-b380-a1a9b4effcba None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:05.048964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 99/191] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:05.052178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45ab1-1efa-4a8e-b380-a1a9b4effcba None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:05.080562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369d472-0de0-4ba7-bf98-a64aa4a261b6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:05.106056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:05.115853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027bba-c3de-4dae-b4ae-0c04ed5337db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:05.116515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027bba-c3de-4dae-b4ae-0c04ed5337db None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.116795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027bba-c3de-4dae-b4ae-0c04ed5337db None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.117102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14027bba-c3de-4dae-b4ae-0c04ed5337db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.163912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:05.171438 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45ab1-1efa-4a8e-b380-a1a9b4effcba None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:05.185363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027bba-c3de-4dae-b4ae-0c04ed5337db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:05.186911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14027bba-c3de-4dae-b4ae-0c04ed5337db None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:05.207067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e32281-192a-427a-93b3-d7729528a07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:05.207745 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e32281-192a-427a-93b3-d7729528a07c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.208024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e32281-192a-427a-93b3-d7729528a07c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.208302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e32281-192a-427a-93b3-d7729528a07c None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.209085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e32281-192a-427a-93b3-d7729528a07c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:05.209392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e32281-192a-427a-93b3-d7729528a07c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:05.210770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e32281-192a-427a-93b3-d7729528a07c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:05.219605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 100/192] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:05.224879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e32281-192a-427a-93b3-d7729528a07c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:05.292271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 93/193] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:05.297736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027bba-c3de-4dae-b4ae-0c04ed5337db None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:05.326033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:05.329459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e32281-192a-427a-93b3-d7729528a07c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:05.365187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c85ba-71c5-4cdb-8e3d-99fa1e3cc9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:05.365868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c85ba-71c5-4cdb-8e3d-99fa1e3cc9fa None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.366154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c85ba-71c5-4cdb-8e3d-99fa1e3cc9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.366427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c85ba-71c5-4cdb-8e3d-99fa1e3cc9fa None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.367137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c85ba-71c5-4cdb-8e3d-99fa1e3cc9fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:05.368610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c85ba-71c5-4cdb-8e3d-99fa1e3cc9fa None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:05.399675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 101/194] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:05 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:05.400721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c85ba-71c5-4cdb-8e3d-99fa1e3cc9fa None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:05.409830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14027bba-c3de-4dae-b4ae-0c04ed5337db None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:05.431427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:05.469540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4b08e-3790-488a-ba59-c7db8346982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:05.471371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4b08e-3790-488a-ba59-c7db8346982a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.472172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4b08e-3790-488a-ba59-c7db8346982a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.472666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4b08e-3790-488a-ba59-c7db8346982a None admin] PATH_INFO: `/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.475215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4b08e-3790-488a-ba59-c7db8346982a None admin] RBAC: Authorizing `identity:get_user(user_id=25c6dded5d8c4df8bb5a43f8f7f54677)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:05.477002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4b08e-3790-488a-ba59-c7db8346982a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:05.479959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 94/195] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:05 2022] GET /identity/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:05.487377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4b08e-3790-488a-ba59-c7db8346982a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:05.537982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c85ba-71c5-4cdb-8e3d-99fa1e3cc9fa None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:05.581496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f112ce-6d9d-4b43-8218-70221e63f2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:05.582371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f112ce-6d9d-4b43-8218-70221e63f2ed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.582782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f112ce-6d9d-4b43-8218-70221e63f2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.583072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f112ce-6d9d-4b43-8218-70221e63f2ed None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.585124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f112ce-6d9d-4b43-8218-70221e63f2ed None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:05.586605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f112ce-6d9d-4b43-8218-70221e63f2ed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:05.588622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 102/196] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:05 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:05.594622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f112ce-6d9d-4b43-8218-70221e63f2ed None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:05.608768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:05.619131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4b08e-3790-488a-ba59-c7db8346982a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:05.672170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4000bb-aad9-43ed-a4c2-8f2bdc88433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:05.672895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4000bb-aad9-43ed-a4c2-8f2bdc88433e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.673184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4000bb-aad9-43ed-a4c2-8f2bdc88433e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.673455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4000bb-aad9-43ed-a4c2-8f2bdc88433e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.707644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:05.736676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f112ce-6d9d-4b43-8218-70221e63f2ed None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:05.783377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4000bb-aad9-43ed-a4c2-8f2bdc88433e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:05.784920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4000bb-aad9-43ed-a4c2-8f2bdc88433e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:05.785443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadc437-0ecb-455e-83bb-c3c06e294eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:05.786326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadc437-0ecb-455e-83bb-c3c06e294eda None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.786992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadc437-0ecb-455e-83bb-c3c06e294eda None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.787277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadc437-0ecb-455e-83bb-c3c06e294eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.789037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadc437-0ecb-455e-83bb-c3c06e294eda None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6, user.id=25c6dded5d8c4df8bb5a43f8f7f54677) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:05.789358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadc437-0ecb-455e-83bb-c3c06e294eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:05.790811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadc437-0ecb-455e-83bb-c3c06e294eda None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:05.798579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 103/197] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:05 2022] GET /identity/v3/role_assignments?user.id=25c6dded5d8c4df8bb5a43f8f7f54677&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=842af9e8967047df873d061df391e820 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:05.897106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:05.904808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 95/198] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:05.907433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65178452-ee55-4a48-9455-45aa99f46684 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.907720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65178452-ee55-4a48-9455-45aa99f46684 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.907995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65178452-ee55-4a48-9455-45aa99f46684 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.909498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 104/199] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:05.910818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4000bb-aad9-43ed-a4c2-8f2bdc88433e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:05.918239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f710f-8005-43c9-ab1b-562cfe440093 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:05.918866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f710f-8005-43c9-ab1b-562cfe440093 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:05.919343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f710f-8005-43c9-ab1b-562cfe440093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:05.938117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-937f710f-8005-43c9-ab1b-562cfe440093 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:05.939739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-937f710f-8005-43c9-ab1b-562cfe440093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:06.017568 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4000bb-aad9-43ed-a4c2-8f2bdc88433e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:06.027510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 105/200] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:06.053409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d50bc-050c-45f0-95cd-420cf116f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:06.054287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d50bc-050c-45f0-95cd-420cf116f617 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:06.054564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d50bc-050c-45f0-95cd-420cf116f617 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:06.054834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d50bc-050c-45f0-95cd-420cf116f617 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:06.056021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d50bc-050c-45f0-95cd-420cf116f617 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:06.057530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d50bc-050c-45f0-95cd-420cf116f617 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:06.059409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 96/201] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:05 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:06.065472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f710f-8005-43c9-ab1b-562cfe440093 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:06.068922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d50bc-050c-45f0-95cd-420cf116f617 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:06.162354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:06.201678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d50bc-050c-45f0-95cd-420cf116f617 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:06.217222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:06.241003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae532d2-f5f9-4ce2-90db-47ba3992d65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:06.241821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae532d2-f5f9-4ce2-90db-47ba3992d65c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:06.242096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae532d2-f5f9-4ce2-90db-47ba3992d65c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:06.242365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae532d2-f5f9-4ce2-90db-47ba3992d65c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:06.250661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f710f-8005-43c9-ab1b-562cfe440093 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:06.262191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae532d2-f5f9-4ce2-90db-47ba3992d65c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1ae532d2-f5f9-4ce2-90db-47ba3992d65c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:06.276891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:06.277783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:06.278556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:06.281333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 97/202] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:06.287700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae532d2-f5f9-4ce2-90db-47ba3992d65c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:06.293432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ddf4-9df3-4f0f-881e-7e5933e9e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:06.294114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ddf4-9df3-4f0f-881e-7e5933e9e16b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:06.294392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ddf4-9df3-4f0f-881e-7e5933e9e16b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:06.294669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40ddf4-9df3-4f0f-881e-7e5933e9e16b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:06.295512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40ddf4-9df3-4f0f-881e-7e5933e9e16b None admin] RBAC: Adding query filter params (role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6, user.id=25c6dded5d8c4df8bb5a43f8f7f54677) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:06.295822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40ddf4-9df3-4f0f-881e-7e5933e9e16b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:06.302346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40ddf4-9df3-4f0f-881e-7e5933e9e16b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:06.311991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 106/203] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:06 2022] GET /identity/v3/role_assignments?user.id=25c6dded5d8c4df8bb5a43f8f7f54677&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:06.437316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae532d2-f5f9-4ce2-90db-47ba3992d65c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:06.463168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:06.483761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e12d69-92f0-47b9-bfde-cf9712c13076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:06.485142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e12d69-92f0-47b9-bfde-cf9712c13076 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:06.485427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e12d69-92f0-47b9-bfde-cf9712c13076 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:06.485722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e12d69-92f0-47b9-bfde-cf9712c13076 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:06.486457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e12d69-92f0-47b9-bfde-cf9712c13076 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:06.486760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e12d69-92f0-47b9-bfde-cf9712c13076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:06.488170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e12d69-92f0-47b9-bfde-cf9712c13076 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:06.498290 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 98/204] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:06.504028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ddf4-9df3-4f0f-881e-7e5933e9e16b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:06.644984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40ddf4-9df3-4f0f-881e-7e5933e9e16b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:06.703153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e4c09-5947-4130-ac63-ac7a625cc97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:06.704305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4c09-5947-4130-ac63-ac7a625cc97d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:06.704722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4c09-5947-4130-ac63-ac7a625cc97d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:06.705149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4c09-5947-4130-ac63-ac7a625cc97d None admin] PATH_INFO: `/v3/users/097236a9cec64ce0971c239c457816d7` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:06.706530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e4c09-5947-4130-ac63-ac7a625cc97d None admin] RBAC: Authorizing `identity:get_user(user_id=097236a9cec64ce0971c239c457816d7)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:06.708129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e4c09-5947-4130-ac63-ac7a625cc97d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:06.710407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 107/205] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:06 2022] GET /identity/v3/users/097236a9cec64ce0971c239c457816d7 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:06.716167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e12d69-92f0-47b9-bfde-cf9712c13076 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:06.843674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e12d69-92f0-47b9-bfde-cf9712c13076 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:06.878112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805211e-0a3e-4801-9db7-ca5d48f6994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:06.878778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805211e-0a3e-4801-9db7-ca5d48f6994c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:06.879061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805211e-0a3e-4801-9db7-ca5d48f6994c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:06.879336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805211e-0a3e-4801-9db7-ca5d48f6994c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:06.934019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:06.950774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805211e-0a3e-4801-9db7-ca5d48f6994c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:06.952346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805211e-0a3e-4801-9db7-ca5d48f6994c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:07.056141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 99/206] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:07.061422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e4c09-5947-4130-ac63-ac7a625cc97d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:07.077232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:07.183144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e4c09-5947-4130-ac63-ac7a625cc97d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:07.216489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94abdd-631d-4619-87f2-e6c980aa6317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:07.217398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94abdd-631d-4619-87f2-e6c980aa6317 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:07.217678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94abdd-631d-4619-87f2-e6c980aa6317 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:07.217952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94abdd-631d-4619-87f2-e6c980aa6317 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:07.219191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94abdd-631d-4619-87f2-e6c980aa6317 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:07.220758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94abdd-631d-4619-87f2-e6c980aa6317 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:07.222736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 108/207] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:07 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:07.228311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805211e-0a3e-4801-9db7-ca5d48f6994c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:07.313279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:07.329583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805211e-0a3e-4801-9db7-ca5d48f6994c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:07.364717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830510f0-c265-4a17-93bd-e340b45e9838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:07.365410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830510f0-c265-4a17-93bd-e340b45e9838 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:07.365692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830510f0-c265-4a17-93bd-e340b45e9838 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:07.365965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830510f0-c265-4a17-93bd-e340b45e9838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:07.366806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830510f0-c265-4a17-93bd-e340b45e9838 None admin] RBAC: Adding query filter params (role.id=554f851c7f784bbc9dc162466570cb20, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24, user.id=097236a9cec64ce0971c239c457816d7) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:07.367116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830510f0-c265-4a17-93bd-e340b45e9838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:07.368634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830510f0-c265-4a17-93bd-e340b45e9838 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:07.374564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 100/208] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:07 2022] GET /identity/v3/role_assignments?user.id=097236a9cec64ce0971c239c457816d7&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=554f851c7f784bbc9dc162466570cb20 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:08.047691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff786f08-cd6c-47f3-8d47-dc5886da7a52 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.048211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff786f08-cd6c-47f3-8d47-dc5886da7a52 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.048211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff786f08-cd6c-47f3-8d47-dc5886da7a52 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.049590 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 109/209] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:08.054917 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f111-695f-4fe7-a4d4-91462e4f2083 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.055313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f111-695f-4fe7-a4d4-91462e4f2083 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.055492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19f111-695f-4fe7-a4d4-91462e4f2083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.072333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7a19f111-695f-4fe7-a4d4-91462e4f2083 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:08.073571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7a19f111-695f-4fe7-a4d4-91462e4f2083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:08.143231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 101/210] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:08.166526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff786f08-cd6c-47f3-8d47-dc5886da7a52 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:08.235195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5225f-8da4-44b4-8552-18197ab1c579 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.235850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5225f-8da4-44b4-8552-18197ab1c579 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.236345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5225f-8da4-44b4-8552-18197ab1c579 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.238266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 102/211] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:08.243697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857123d-d6bb-437b-b260-ee2991f06b72 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.244239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857123d-d6bb-437b-b260-ee2991f06b72 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.244711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857123d-d6bb-437b-b260-ee2991f06b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.253208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:08.261724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4857123d-d6bb-437b-b260-ee2991f06b72 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:08.262933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4857123d-d6bb-437b-b260-ee2991f06b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:08.278327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff786f08-cd6c-47f3-8d47-dc5886da7a52 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:08.322484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad298097-c3b7-4a16-b0d7-999d7ab55504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:08.323210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad298097-c3b7-4a16-b0d7-999d7ab55504 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.323492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad298097-c3b7-4a16-b0d7-999d7ab55504 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.323875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad298097-c3b7-4a16-b0d7-999d7ab55504 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.335269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad298097-c3b7-4a16-b0d7-999d7ab55504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ad298097-c3b7-4a16-b0d7-999d7ab55504 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:08.343035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:08.344223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:08.345485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:08.346076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 103/212] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:08.346144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 110/213] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:08.350064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857123d-d6bb-437b-b260-ee2991f06b72 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:08.362980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:08.364585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abce6b-250f-4cdd-a344-e0e1d5b1ce2f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.364888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abce6b-250f-4cdd-a344-e0e1d5b1ce2f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.365171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4abce6b-250f-4cdd-a344-e0e1d5b1ce2f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.366777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 111/214] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:08.369650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abce6b-250f-4cdd-a344-e0e1d5b1ce2f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:08.450354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857123d-d6bb-437b-b260-ee2991f06b72 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:08.480074 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4abce6b-250f-4cdd-a344-e0e1d5b1ce2f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:08.486759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45a189-48b0-42ec-8e56-d53c921e99f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:08.487440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45a189-48b0-42ec-8e56-d53c921e99f1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.487718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45a189-48b0-42ec-8e56-d53c921e99f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.487987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45a189-48b0-42ec-8e56-d53c921e99f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.488747 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45a189-48b0-42ec-8e56-d53c921e99f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:08.489080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45a189-48b0-42ec-8e56-d53c921e99f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:08.490501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45a189-48b0-42ec-8e56-d53c921e99f1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:08.500054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 104/215] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:08.501529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704be2-b20c-46d8-8a22-02f3d00f52bd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.502007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704be2-b20c-46d8-8a22-02f3d00f52bd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.503821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0704be2-b20c-46d8-8a22-02f3d00f52bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.520892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f0704be2-b20c-46d8-8a22-02f3d00f52bd None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:08.522271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f0704be2-b20c-46d8-8a22-02f3d00f52bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:08.524183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23cf8b-5329-45f3-9acb-6287af5fa779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:08.525069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23cf8b-5329-45f3-9acb-6287af5fa779 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.525910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23cf8b-5329-45f3-9acb-6287af5fa779 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.525910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23cf8b-5329-45f3-9acb-6287af5fa779 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.526877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23cf8b-5329-45f3-9acb-6287af5fa779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:08.528410 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23cf8b-5329-45f3-9acb-6287af5fa779 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:08.530238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 112/216] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:08.531022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23cf8b-5329-45f3-9acb-6287af5fa779 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:08.535311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:08.593512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:08.608201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 105/217] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:08.609505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0704be2-b20c-46d8-8a22-02f3d00f52bd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:08.637115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23cf8b-5329-45f3-9acb-6287af5fa779 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:08.676707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8f00-3175-48ac-8b64-b9ae8ef6bfd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:08.677626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8f00-3175-48ac-8b64-b9ae8ef6bfd5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.677912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8f00-3175-48ac-8b64-b9ae8ef6bfd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.678184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd8f00-3175-48ac-8b64-b9ae8ef6bfd5 None admin] PATH_INFO: `/v3/users/e0d661191cde45bb861f3e0ddb57ef10` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.692693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd8f00-3175-48ac-8b64-b9ae8ef6bfd5 None admin] RBAC: Authorizing `identity:get_user(user_id=e0d661191cde45bb861f3e0ddb57ef10)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:08.694330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd8f00-3175-48ac-8b64-b9ae8ef6bfd5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:08.696275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 113/218] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:08 2022] GET /identity/v3/users/e0d661191cde45bb861f3e0ddb57ef10 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:08.696906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8f00-3175-48ac-8b64-b9ae8ef6bfd5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:08.717084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0704be2-b20c-46d8-8a22-02f3d00f52bd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:08.755247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1b1ac-eac9-4b3f-a2fa-3f954f6a989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:08.755935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1b1ac-eac9-4b3f-a2fa-3f954f6a989a None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.756229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1b1ac-eac9-4b3f-a2fa-3f954f6a989a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.756487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1b1ac-eac9-4b3f-a2fa-3f954f6a989a None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.757250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1b1ac-eac9-4b3f-a2fa-3f954f6a989a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:08.758752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1b1ac-eac9-4b3f-a2fa-3f954f6a989a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:08.760733 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:08.779124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 106/219] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:08 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:08.779124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e107ab0-fc81-4d17-9bdf-560908ae60fc None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.779124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e107ab0-fc81-4d17-9bdf-560908ae60fc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.779124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e107ab0-fc81-4d17-9bdf-560908ae60fc None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.779124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 107/220] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:08.779124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e107ab0-fc81-4d17-9bdf-560908ae60fc None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:08.806975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd8f00-3175-48ac-8b64-b9ae8ef6bfd5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:08.846374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19709936-9ccd-44a2-9c68-0508b6013ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:08.847126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19709936-9ccd-44a2-9c68-0508b6013ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.847392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19709936-9ccd-44a2-9c68-0508b6013ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.847665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19709936-9ccd-44a2-9c68-0508b6013ff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.857393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:08.862217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19709936-9ccd-44a2-9c68-0508b6013ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-19709936-9ccd-44a2-9c68-0508b6013ff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:08.870359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:08.871357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:08.872144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 114/221] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:17:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:08.873325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b91af-44f1-446a-8c30-4c49b7eb4e94 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.873325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b91af-44f1-446a-8c30-4c49b7eb4e94 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.873589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b91af-44f1-446a-8c30-4c49b7eb4e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:08.893112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c89b91af-44f1-446a-8c30-4c49b7eb4e94 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:08.894355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c89b91af-44f1-446a-8c30-4c49b7eb4e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:08.920562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e107ab0-fc81-4d17-9bdf-560908ae60fc None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:08.964867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d0ee0-2511-4251-a8db-fa1609c27464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:08.965093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 115/222] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:08.965891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d0ee0-2511-4251-a8db-fa1609c27464 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:08.965997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b91af-44f1-446a-8c30-4c49b7eb4e94 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:08.966302 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d0ee0-2511-4251-a8db-fa1609c27464 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:08.966585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d0ee0-2511-4251-a8db-fa1609c27464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:09.039489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:09.060763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d0ee0-2511-4251-a8db-fa1609c27464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:09.063342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d0ee0-2511-4251-a8db-fa1609c27464 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:09.098330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b91af-44f1-446a-8c30-4c49b7eb4e94 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:09.130945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:09.149999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275514c8-3d1d-4ae5-aed5-0a53def74d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:09.152027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275514c8-3d1d-4ae5-aed5-0a53def74d40 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:09.152537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275514c8-3d1d-4ae5-aed5-0a53def74d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:09.153463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275514c8-3d1d-4ae5-aed5-0a53def74d40 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:09.154810 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275514c8-3d1d-4ae5-aed5-0a53def74d40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:09.155586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275514c8-3d1d-4ae5-aed5-0a53def74d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:09.157718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275514c8-3d1d-4ae5-aed5-0a53def74d40 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:09.170109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 116/223] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:09.171535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275514c8-3d1d-4ae5-aed5-0a53def74d40 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:09.183229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 108/224] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:09.185007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d0ee0-2511-4251-a8db-fa1609c27464 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:09.277792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275514c8-3d1d-4ae5-aed5-0a53def74d40 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:09.297298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:09.314265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d0ee0-2511-4251-a8db-fa1609c27464 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:09.326808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7d212-6cf8-4f73-b1b5-b165b09b6676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:09.328446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7d212-6cf8-4f73-b1b5-b165b09b6676 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:09.329388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7d212-6cf8-4f73-b1b5-b165b09b6676 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:09.329861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7d212-6cf8-4f73-b1b5-b165b09b6676 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:09.344183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d7d212-6cf8-4f73-b1b5-b165b09b6676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:09.349328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836835da-a880-4e1e-b577-2038b001f4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:09.350250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836835da-a880-4e1e-b577-2038b001f4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:09.350603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836835da-a880-4e1e-b577-2038b001f4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:09.350946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836835da-a880-4e1e-b577-2038b001f4f4 None admin] PATH_INFO: `/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:09.352303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836835da-a880-4e1e-b577-2038b001f4f4 None admin] RBAC: Authorizing `identity:get_user(user_id=25c6dded5d8c4df8bb5a43f8f7f54677)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:09.353893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836835da-a880-4e1e-b577-2038b001f4f4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-61d7d212-6cf8-4f73-b1b5-b165b09b6676 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:09.355680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:09.356497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:09.357306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:09.360961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 117/226] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:09.360961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7d212-6cf8-4f73-b1b5-b165b09b6676 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:09.361153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 109/226] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:09 2022] GET /identity/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:09.361793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836835da-a880-4e1e-b577-2038b001f4f4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:09.398798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:09.481554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7d212-6cf8-4f73-b1b5-b165b09b6676 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:09.496729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836835da-a880-4e1e-b577-2038b001f4f4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:09.528643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208e30b-18ee-4a9e-b07c-bd556c672e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:09.530560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208e30b-18ee-4a9e-b07c-bd556c672e14 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:09.531175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208e30b-18ee-4a9e-b07c-bd556c672e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:09.531818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208e30b-18ee-4a9e-b07c-bd556c672e14 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:09.533617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208e30b-18ee-4a9e-b07c-bd556c672e14 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:09.535276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7940fa-6486-4f0a-b448-1a1256028345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:09.535823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208e30b-18ee-4a9e-b07c-bd556c672e14 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:09.536145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7940fa-6486-4f0a-b448-1a1256028345 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:09.536421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7940fa-6486-4f0a-b448-1a1256028345 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:09.536690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7940fa-6486-4f0a-b448-1a1256028345 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:09.537918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7940fa-6486-4f0a-b448-1a1256028345 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:09.538705 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 118/227] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:09 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:09.539377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7940fa-6486-4f0a-b448-1a1256028345 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:09.540063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208e30b-18ee-4a9e-b07c-bd556c672e14 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:09.541241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 110/228] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:09 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:09.545761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7940fa-6486-4f0a-b448-1a1256028345 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:09.605288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:09.654083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:09.667408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7940fa-6486-4f0a-b448-1a1256028345 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:09.668077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208e30b-18ee-4a9e-b07c-bd556c672e14 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:09.703367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e159-6b44-4361-af81-76cf4fc8a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:09.704185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e159-6b44-4361-af81-76cf4fc8a69b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:09.704569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e159-6b44-4361-af81-76cf4fc8a69b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:09.704971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e159-6b44-4361-af81-76cf4fc8a69b None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:09.705829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e159-6b44-4361-af81-76cf4fc8a69b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:09.706203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e159-6b44-4361-af81-76cf4fc8a69b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:09.707676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e159-6b44-4361-af81-76cf4fc8a69b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:09.711228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525818d-a482-429e-b8e3-ccb370dd111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:09.712055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525818d-a482-429e-b8e3-ccb370dd111f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:09.712478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525818d-a482-429e-b8e3-ccb370dd111f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:09.712930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525818d-a482-429e-b8e3-ccb370dd111f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:09.714475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525818d-a482-429e-b8e3-ccb370dd111f None admin] RBAC: Adding query filter params (role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6, user.id=e0d661191cde45bb861f3e0ddb57ef10) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:09.715052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525818d-a482-429e-b8e3-ccb370dd111f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:09.716613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 119/229] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:09.717089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525818d-a482-429e-b8e3-ccb370dd111f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:09.717634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e159-6b44-4361-af81-76cf4fc8a69b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:09.724913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 111/230] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:09 2022] GET /identity/v3/role_assignments?user.id=e0d661191cde45bb861f3e0ddb57ef10&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:09.726008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525818d-a482-429e-b8e3-ccb370dd111f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:09.930813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525818d-a482-429e-b8e3-ccb370dd111f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:09.958674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e159-6b44-4361-af81-76cf4fc8a69b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:09.967969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:09.970389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c989e-7d6b-466f-b29d-144a689ad243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:09.971288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c989e-7d6b-466f-b29d-144a689ad243 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:09.971564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c989e-7d6b-466f-b29d-144a689ad243 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:09.971836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c989e-7d6b-466f-b29d-144a689ad243 None admin] PATH_INFO: `/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:09.973652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c989e-7d6b-466f-b29d-144a689ad243 None admin] RBAC: Authorizing `identity:get_user(user_id=25c6dded5d8c4df8bb5a43f8f7f54677)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:09.975167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c989e-7d6b-466f-b29d-144a689ad243 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:09.978292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 112/231] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:09 2022] GET /identity/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:09.986968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c989e-7d6b-466f-b29d-144a689ad243 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:10.034137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291ef1-0264-437b-8e6f-bf6479b19201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:10.035080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291ef1-0264-437b-8e6f-bf6479b19201 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:10.035363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291ef1-0264-437b-8e6f-bf6479b19201 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:10.035633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad291ef1-0264-437b-8e6f-bf6479b19201 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/users/25c6dded5d8c4df8bb5a43f8f7f54677/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:10.038046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:10.042769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad291ef1-0264-437b-8e6f-bf6479b19201 None admin] RBAC: Authorizing `identity:create_grant(project_id=698dfbe68a2342439db4f2b52c2b34a6, user_id=25c6dded5d8c4df8bb5a43f8f7f54677, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:10.044285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad291ef1-0264-437b-8e6f-bf6479b19201 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:10.078951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 120/232] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:09 2022] PUT /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/users/25c6dded5d8c4df8bb5a43f8f7f54677/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:10.147006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c989e-7d6b-466f-b29d-144a689ad243 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:10.201181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757de306-8b97-46da-886a-ac2bf28a6807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:10.202426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de306-8b97-46da-886a-ac2bf28a6807 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:10.202936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de306-8b97-46da-886a-ac2bf28a6807 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:10.203484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757de306-8b97-46da-886a-ac2bf28a6807 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:10.204999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757de306-8b97-46da-886a-ac2bf28a6807 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:10.206733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757de306-8b97-46da-886a-ac2bf28a6807 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:10.212956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 113/233] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:09 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:10.218030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291ef1-0264-437b-8e6f-bf6479b19201 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:10.359180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad291ef1-0264-437b-8e6f-bf6479b19201 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:10.401401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d846e-7b4b-4c60-ab11-b52a2b280227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:10.402316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d846e-7b4b-4c60-ab11-b52a2b280227 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:10.402596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d846e-7b4b-4c60-ab11-b52a2b280227 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:10.402870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d846e-7b4b-4c60-ab11-b52a2b280227 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/users/25c6dded5d8c4df8bb5a43f8f7f54677/roles/a97ad9c1458d4bf3a071884c10cae46c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:10.410695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d846e-7b4b-4c60-ab11-b52a2b280227 None admin] RBAC: Authorizing `identity:create_grant(project_id=698dfbe68a2342439db4f2b52c2b34a6, user_id=25c6dded5d8c4df8bb5a43f8f7f54677, role_id=a97ad9c1458d4bf3a071884c10cae46c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:10.412191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d846e-7b4b-4c60-ab11-b52a2b280227 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:10.444154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 121/234] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:10 2022] PUT /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/users/25c6dded5d8c4df8bb5a43f8f7f54677/roles/a97ad9c1458d4bf3a071884c10cae46c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:11.126988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304249d-7717-4a2e-95bf-da2ff9f64ebf None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:11.127707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304249d-7717-4a2e-95bf-da2ff9f64ebf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:11.128193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304249d-7717-4a2e-95bf-da2ff9f64ebf None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:11.128362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877ad54-3d3a-4aff-a39e-4d37b2ac5efb None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:11.128618 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877ad54-3d3a-4aff-a39e-4d37b2ac5efb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:11.128923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877ad54-3d3a-4aff-a39e-4d37b2ac5efb None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:11.130397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 114/235] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:11.130613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 122/236] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:11.135871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754829f-b976-4645-b8a8-4d6812374e8e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:11.136034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed13624-4f3e-4a5f-9dcf-c6dc7e127915 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:11.136244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed13624-4f3e-4a5f-9dcf-c6dc7e127915 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:11.136424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed13624-4f3e-4a5f-9dcf-c6dc7e127915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:11.136919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754829f-b976-4645-b8a8-4d6812374e8e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:11.137388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754829f-b976-4645-b8a8-4d6812374e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:11.160361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0ed13624-4f3e-4a5f-9dcf-c6dc7e127915 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:11.161584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0ed13624-4f3e-4a5f-9dcf-c6dc7e127915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:11.169158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b754829f-b976-4645-b8a8-4d6812374e8e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:11.170379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b754829f-b976-4645-b8a8-4d6812374e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:11.202950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:11.286207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 123/237] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:11.290880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 115/238] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:11.310414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed13624-4f3e-4a5f-9dcf-c6dc7e127915 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:11.327781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754829f-b976-4645-b8a8-4d6812374e8e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:11.369199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:11.438080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed13624-4f3e-4a5f-9dcf-c6dc7e127915 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:11.476799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd9f7-574d-4b84-9485-3c2bcb869fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:11.477658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd9f7-574d-4b84-9485-3c2bcb869fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:11.478423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd9f7-574d-4b84-9485-3c2bcb869fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:11.478699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd9f7-574d-4b84-9485-3c2bcb869fa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:11.480127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acd9f7-574d-4b84-9485-3c2bcb869fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:11.481746 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acd9f7-574d-4b84-9485-3c2bcb869fa1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:11.483456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 124/239] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:11.490351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd9f7-574d-4b84-9485-3c2bcb869fa1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:11.515044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754829f-b976-4645-b8a8-4d6812374e8e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:11.521423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:11.584893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8f711-4337-4430-b046-9896a48be7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:11.585641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8f711-4337-4430-b046-9896a48be7da None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:11.585926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8f711-4337-4430-b046-9896a48be7da None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:11.586199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8f711-4337-4430-b046-9896a48be7da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:11.605905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd9f7-574d-4b84-9485-3c2bcb869fa1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:11.617492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8f711-4337-4430-b046-9896a48be7da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-58c8f711-4337-4430-b046-9896a48be7da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:11.629692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:11.630603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:11.632217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 116/240] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:11.638618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8f711-4337-4430-b046-9896a48be7da None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:11.673870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c0657-cec7-458d-b043-349012daea30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:11.674552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c0657-cec7-458d-b043-349012daea30 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:11.674827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c0657-cec7-458d-b043-349012daea30 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:11.677102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c0657-cec7-458d-b043-349012daea30 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:11.677873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c0657-cec7-458d-b043-349012daea30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:11.679352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c0657-cec7-458d-b043-349012daea30 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:11.731690 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 125/241] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:11 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:11.747753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:11.770422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8f711-4337-4430-b046-9896a48be7da None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:11.816752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c76260-9ff9-4300-8b82-c036b81c2d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:11.817491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c76260-9ff9-4300-8b82-c036b81c2d75 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:11.817773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c76260-9ff9-4300-8b82-c036b81c2d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:11.818045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c76260-9ff9-4300-8b82-c036b81c2d75 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:11.818815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c76260-9ff9-4300-8b82-c036b81c2d75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:11.819120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c76260-9ff9-4300-8b82-c036b81c2d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:11.820532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c76260-9ff9-4300-8b82-c036b81c2d75 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:11.837831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 117/242] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:11.843918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c0657-cec7-458d-b043-349012daea30 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:11.961702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:11.983892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c0657-cec7-458d-b043-349012daea30 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:12.020258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b63149-8f04-48c9-a8b6-93c7d1d1cf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:12.021194 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b63149-8f04-48c9-a8b6-93c7d1d1cf7a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.021467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b63149-8f04-48c9-a8b6-93c7d1d1cf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.021739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b63149-8f04-48c9-a8b6-93c7d1d1cf7a None admin] PATH_INFO: `/v3/users/aa1df54f31654fd9b54e8c671648eeeb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.035896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b63149-8f04-48c9-a8b6-93c7d1d1cf7a None admin] RBAC: Authorizing `identity:get_user(user_id=aa1df54f31654fd9b54e8c671648eeeb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:12.037441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b63149-8f04-48c9-a8b6-93c7d1d1cf7a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:12.039507 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 126/243] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:11 2022] GET /identity/v3/users/aa1df54f31654fd9b54e8c671648eeeb => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:12.045081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c76260-9ff9-4300-8b82-c036b81c2d75 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:12.174389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c76260-9ff9-4300-8b82-c036b81c2d75 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:12.202736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea89b21-14d7-4113-bd89-e4210fdd04e4 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.202736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea89b21-14d7-4113-bd89-e4210fdd04e4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.202736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea89b21-14d7-4113-bd89-e4210fdd04e4 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.203597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 127/244] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:12.211165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e241d-f039-43c9-8d74-ce7a429adfdc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.213836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e241d-f039-43c9-8d74-ce7a429adfdc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.213836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e241d-f039-43c9-8d74-ce7a429adfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.221711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247d30-5bd8-48ff-8ee3-4db0e00e7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:12.222377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247d30-5bd8-48ff-8ee3-4db0e00e7854 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.222654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247d30-5bd8-48ff-8ee3-4db0e00e7854 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.222920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247d30-5bd8-48ff-8ee3-4db0e00e7854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.237704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9d9e241d-f039-43c9-8d74-ce7a429adfdc None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:12.239310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9d9e241d-f039-43c9-8d74-ce7a429adfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:12.244102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:12.331320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247d30-5bd8-48ff-8ee3-4db0e00e7854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:12.332899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247d30-5bd8-48ff-8ee3-4db0e00e7854 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:12.344918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 128/245] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:12.368381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e241d-f039-43c9-8d74-ce7a429adfdc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:12.444000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:12.465738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 118/246] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:12.471715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247d30-5bd8-48ff-8ee3-4db0e00e7854 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:12.497114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e241d-f039-43c9-8d74-ce7a429adfdc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:12.537513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f7529-31c1-4297-8f0e-5afc8270e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:12.538330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f7529-31c1-4297-8f0e-5afc8270e343 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.538612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f7529-31c1-4297-8f0e-5afc8270e343 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.538889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f7529-31c1-4297-8f0e-5afc8270e343 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.550939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f7529-31c1-4297-8f0e-5afc8270e343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f65f7529-31c1-4297-8f0e-5afc8270e343 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:12.559815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:12.560706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:12.561520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 129/247] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:12.569128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f7529-31c1-4297-8f0e-5afc8270e343 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:12.583195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:12.693453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247d30-5bd8-48ff-8ee3-4db0e00e7854 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:12.705273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f7529-31c1-4297-8f0e-5afc8270e343 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:12.748714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:12.767131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dcdb0-b7f0-438e-98f8-f71b7b14e119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:12.768013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dcdb0-b7f0-438e-98f8-f71b7b14e119 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.768291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dcdb0-b7f0-438e-98f8-f71b7b14e119 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.768561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dcdb0-b7f0-438e-98f8-f71b7b14e119 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.770155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dcdb0-b7f0-438e-98f8-f71b7b14e119 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:12.771626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dcdb0-b7f0-438e-98f8-f71b7b14e119 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:12.775174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be85bd-cc6f-4237-a18b-d2bbde2e7245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:12.775857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be85bd-cc6f-4237-a18b-d2bbde2e7245 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.776138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be85bd-cc6f-4237-a18b-d2bbde2e7245 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.776410 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be85bd-cc6f-4237-a18b-d2bbde2e7245 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.777227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be85bd-cc6f-4237-a18b-d2bbde2e7245 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:12.777534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be85bd-cc6f-4237-a18b-d2bbde2e7245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:12.778928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be85bd-cc6f-4237-a18b-d2bbde2e7245 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:12.780385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 119/248] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:12 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:12.781855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f90933-d991-431a-8282-edb8a8837e6c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.782136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f90933-d991-431a-8282-edb8a8837e6c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.782415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f90933-d991-431a-8282-edb8a8837e6c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.783745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 120/249] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:12.784436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f90933-d991-431a-8282-edb8a8837e6c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:12.803294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 130/250] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:12.804652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86971744-f8ce-4901-b1b6-b9a0ba0ffdf1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.804980 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86971744-f8ce-4901-b1b6-b9a0ba0ffdf1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.805268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86971744-f8ce-4901-b1b6-b9a0ba0ffdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.838460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-86971744-f8ce-4901-b1b6-b9a0ba0ffdf1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:12.839681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-86971744-f8ce-4901-b1b6-b9a0ba0ffdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:12.898916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f90933-d991-431a-8282-edb8a8837e6c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:12.913515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:12.935398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22d16b-f6f4-4f21-b13e-ead59d673b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:12.935398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22d16b-f6f4-4f21-b13e-ead59d673b1d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:12.935661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22d16b-f6f4-4f21-b13e-ead59d673b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:12.935933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22d16b-f6f4-4f21-b13e-ead59d673b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:12.936783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22d16b-f6f4-4f21-b13e-ead59d673b1d None admin] RBAC: Adding query filter params (role.id=554f851c7f784bbc9dc162466570cb20, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6, user.id=aa1df54f31654fd9b54e8c671648eeeb) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:12.937124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22d16b-f6f4-4f21-b13e-ead59d673b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:12.940256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22d16b-f6f4-4f21-b13e-ead59d673b1d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:12.944591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 121/251] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:12 2022] GET /identity/v3/role_assignments?user.id=aa1df54f31654fd9b54e8c671648eeeb&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=554f851c7f784bbc9dc162466570cb20 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:12.945427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22d16b-f6f4-4f21-b13e-ead59d673b1d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:12.999302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 131/252] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:13.023805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86971744-f8ce-4901-b1b6-b9a0ba0ffdf1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:13.127519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22d16b-f6f4-4f21-b13e-ead59d673b1d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:13.189289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86971744-f8ce-4901-b1b6-b9a0ba0ffdf1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:13.209222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492be15-0490-45e9-9685-60345999f940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:13.210686 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492be15-0490-45e9-9685-60345999f940 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:13.211167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492be15-0490-45e9-9685-60345999f940 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:13.211612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492be15-0490-45e9-9685-60345999f940 None admin] PATH_INFO: `/v3/users/e0d661191cde45bb861f3e0ddb57ef10` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:13.211891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:13.213227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492be15-0490-45e9-9685-60345999f940 None admin] RBAC: Authorizing `identity:get_user(user_id=e0d661191cde45bb861f3e0ddb57ef10)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:13.214905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492be15-0490-45e9-9685-60345999f940 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:13.216900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 122/253] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:12 2022] GET /identity/v3/users/e0d661191cde45bb861f3e0ddb57ef10 => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:13.218253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cede02-cf1f-426d-be74-430c0d9dc0b6 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:13.218757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cede02-cf1f-426d-be74-430c0d9dc0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:13.219202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cede02-cf1f-426d-be74-430c0d9dc0b6 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:13.220680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 123/254] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:13.224202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cede02-cf1f-426d-be74-430c0d9dc0b6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:13.240785 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d8f8d-0013-408b-af72-5bd7c8e6fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:13.241652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8f8d-0013-408b-af72-5bd7c8e6fba0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:13.241934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8f8d-0013-408b-af72-5bd7c8e6fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:13.242209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d8f8d-0013-408b-af72-5bd7c8e6fba0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:13.255778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d8f8d-0013-408b-af72-5bd7c8e6fba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-053d8f8d-0013-408b-af72-5bd7c8e6fba0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:13.264073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:13.265025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:13.265851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:13.268183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 132/255] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:17:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:13.269777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f24bb-8907-4545-b161-d0ebd76b3b3c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:13.270279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f24bb-8907-4545-b161-d0ebd76b3b3c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:13.271115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f24bb-8907-4545-b161-d0ebd76b3b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:13.289754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8d1f24bb-8907-4545-b161-d0ebd76b3b3c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:13.291261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8d1f24bb-8907-4545-b161-d0ebd76b3b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:13.302618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:13.363621 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 133/256] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:13.378972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f24bb-8907-4545-b161-d0ebd76b3b3c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:13.395579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cede02-cf1f-426d-be74-430c0d9dc0b6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:13.430103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55fc56-e2b7-48f9-9a9a-3a897b7ba24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:13.431275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55fc56-e2b7-48f9-9a9a-3a897b7ba24b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:13.431696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55fc56-e2b7-48f9-9a9a-3a897b7ba24b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:13.432107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55fc56-e2b7-48f9-9a9a-3a897b7ba24b None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:13.433487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55fc56-e2b7-48f9-9a9a-3a897b7ba24b None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:13.435219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55fc56-e2b7-48f9-9a9a-3a897b7ba24b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:13.437517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 124/257] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:13 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:13.438639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55fc56-e2b7-48f9-9a9a-3a897b7ba24b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:13.543268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55fc56-e2b7-48f9-9a9a-3a897b7ba24b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:13.573222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:13.581480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae00b15-718b-44f7-b770-82d6d9c3c35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:13.582567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae00b15-718b-44f7-b770-82d6d9c3c35d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:13.583103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae00b15-718b-44f7-b770-82d6d9c3c35d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:13.583554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae00b15-718b-44f7-b770-82d6d9c3c35d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:13.594556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae00b15-718b-44f7-b770-82d6d9c3c35d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3ae00b15-718b-44f7-b770-82d6d9c3c35d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:13.604068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:13.604995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:13.605796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:13.610183 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 125/258] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:13.611684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae00b15-718b-44f7-b770-82d6d9c3c35d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:13.692653 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f24bb-8907-4545-b161-d0ebd76b3b3c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:13.703666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:13.730323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd968f7-65b5-4b0f-a434-2246c288f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:13.731271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd968f7-65b5-4b0f-a434-2246c288f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:13.731692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd968f7-65b5-4b0f-a434-2246c288f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:13.732350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd968f7-65b5-4b0f-a434-2246c288f3e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:13.734572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd968f7-65b5-4b0f-a434-2246c288f3e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:13.735087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd968f7-65b5-4b0f-a434-2246c288f3e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:13.736703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd968f7-65b5-4b0f-a434-2246c288f3e4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:13.746788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 134/259] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:13.747866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd968f7-65b5-4b0f-a434-2246c288f3e4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:13.859122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae00b15-718b-44f7-b770-82d6d9c3c35d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:13.863514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd968f7-65b5-4b0f-a434-2246c288f3e4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:13.900130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb7d2a-588e-45da-a1fd-c4cf2e080864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:13.901190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb7d2a-588e-45da-a1fd-c4cf2e080864 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:13.902115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb7d2a-588e-45da-a1fd-c4cf2e080864 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:13.902591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb7d2a-588e-45da-a1fd-c4cf2e080864 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:13.903551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb7d2a-588e-45da-a1fd-c4cf2e080864 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:13.904068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb7d2a-588e-45da-a1fd-c4cf2e080864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:13.905906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb7d2a-588e-45da-a1fd-c4cf2e080864 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:13.915375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 135/260] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:13.916866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb7d2a-588e-45da-a1fd-c4cf2e080864 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:13.952304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:13.985559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934088-bb1c-4f33-8bb5-150aa9baf702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:13.986706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934088-bb1c-4f33-8bb5-150aa9baf702 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:13.986814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934088-bb1c-4f33-8bb5-150aa9baf702 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:13.987008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1934088-bb1c-4f33-8bb5-150aa9baf702 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/users/e0d661191cde45bb861f3e0ddb57ef10/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:13.997645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1934088-bb1c-4f33-8bb5-150aa9baf702 None admin] RBAC: Authorizing `identity:create_grant(project_id=698dfbe68a2342439db4f2b52c2b34a6, user_id=e0d661191cde45bb861f3e0ddb57ef10, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:13.999129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1934088-bb1c-4f33-8bb5-150aa9baf702 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:14.029391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb7d2a-588e-45da-a1fd-c4cf2e080864 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:14.036269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 126/261] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:13 2022] PUT /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/users/e0d661191cde45bb861f3e0ddb57ef10/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:14.036986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934088-bb1c-4f33-8bb5-150aa9baf702 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:14.069349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9857b2-9104-4066-8f3f-24ecd8a06d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:14.071145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9857b2-9104-4066-8f3f-24ecd8a06d33 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:14.071668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9857b2-9104-4066-8f3f-24ecd8a06d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:14.072203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9857b2-9104-4066-8f3f-24ecd8a06d33 None admin] PATH_INFO: `/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:14.074153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9857b2-9104-4066-8f3f-24ecd8a06d33 None admin] RBAC: Authorizing `identity:get_user(user_id=25c6dded5d8c4df8bb5a43f8f7f54677)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:14.076308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9857b2-9104-4066-8f3f-24ecd8a06d33 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:14.079011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 136/262] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:13 2022] GET /identity/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:14.084761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9857b2-9104-4066-8f3f-24ecd8a06d33 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:14.150418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:14.217518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9857b2-9104-4066-8f3f-24ecd8a06d33 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:14.219876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:14.256767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e7050-c941-4664-a6a8-a65ba7dd46df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:14.257903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e7050-c941-4664-a6a8-a65ba7dd46df None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:14.258594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e7050-c941-4664-a6a8-a65ba7dd46df None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:14.259067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e7050-c941-4664-a6a8-a65ba7dd46df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:14.338705 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e7050-c941-4664-a6a8-a65ba7dd46df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:14.340606 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e7050-c941-4664-a6a8-a65ba7dd46df None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:14.414891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1934088-bb1c-4f33-8bb5-150aa9baf702 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:14.450706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 137/263] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:14.453111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:14.457820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e7050-c941-4664-a6a8-a65ba7dd46df None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:14.528537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b551c0-49cf-4661-b1e1-ac6d4e20da10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:14.529499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b551c0-49cf-4661-b1e1-ac6d4e20da10 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:14.529776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b551c0-49cf-4661-b1e1-ac6d4e20da10 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:14.530047 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b551c0-49cf-4661-b1e1-ac6d4e20da10 None admin] PATH_INFO: `/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:14.532021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b551c0-49cf-4661-b1e1-ac6d4e20da10 None admin] RBAC: Authorizing `identity:get_user(user_id=25c6dded5d8c4df8bb5a43f8f7f54677)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:14.534029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b551c0-49cf-4661-b1e1-ac6d4e20da10 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:14.536595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 127/264] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:14 2022] GET /identity/v3/users/25c6dded5d8c4df8bb5a43f8f7f54677 => generated 283 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:14.537937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3955c50-9cfb-470f-aeb5-36c501926812 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:14.538217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3955c50-9cfb-470f-aeb5-36c501926812 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:14.538485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3955c50-9cfb-470f-aeb5-36c501926812 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:14.539970 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 128/265] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:14.544515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3955c50-9cfb-470f-aeb5-36c501926812 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:14.574808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e7050-c941-4664-a6a8-a65ba7dd46df None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:14.623008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093344e-b5ff-4d01-9d30-3e34db394590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:14.625506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093344e-b5ff-4d01-9d30-3e34db394590 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:14.626959 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093344e-b5ff-4d01-9d30-3e34db394590 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:14.627433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093344e-b5ff-4d01-9d30-3e34db394590 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:14.632045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093344e-b5ff-4d01-9d30-3e34db394590 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:14.633793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093344e-b5ff-4d01-9d30-3e34db394590 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:14.638409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 138/266] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:14 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:14.640160 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2926a5-1e43-4bbc-8de6-3ec8fab99eb2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:14.642188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2926a5-1e43-4bbc-8de6-3ec8fab99eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:14.644171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2926a5-1e43-4bbc-8de6-3ec8fab99eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:14.684297 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-aa2926a5-1e43-4bbc-8de6-3ec8fab99eb2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:14.685852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-aa2926a5-1e43-4bbc-8de6-3ec8fab99eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:14.705393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:14.712162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3955c50-9cfb-470f-aeb5-36c501926812 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:14.782242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd1ec4-cb8b-4e2a-873e-2a52cf315ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:14.782950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd1ec4-cb8b-4e2a-873e-2a52cf315ffa None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:14.783228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd1ec4-cb8b-4e2a-873e-2a52cf315ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:14.783535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd1ec4-cb8b-4e2a-873e-2a52cf315ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:14.801256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:14.810118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 139/267] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:14.818752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2926a5-1e43-4bbc-8de6-3ec8fab99eb2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:14.891899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd1ec4-cb8b-4e2a-873e-2a52cf315ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:14.893521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd1ec4-cb8b-4e2a-873e-2a52cf315ffa None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:14.953036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2926a5-1e43-4bbc-8de6-3ec8fab99eb2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:15.000676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175de590-c94f-48f0-9341-95b32b4c0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:15.001367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de590-c94f-48f0-9341-95b32b4c0864 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.001652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de590-c94f-48f0-9341-95b32b4c0864 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.001930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de590-c94f-48f0-9341-95b32b4c0864 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.003288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175de590-c94f-48f0-9341-95b32b4c0864 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6, user.id=25c6dded5d8c4df8bb5a43f8f7f54677) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:15.003601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175de590-c94f-48f0-9341-95b32b4c0864 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:15.005637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175de590-c94f-48f0-9341-95b32b4c0864 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:15.013451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:15.014937 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 140/268] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:14 2022] GET /identity/v3/role_assignments?user.id=25c6dded5d8c4df8bb5a43f8f7f54677&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=842af9e8967047df873d061df391e820 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:15.016442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fb995-6136-4805-8968-f4226a76a155 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.016782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fb995-6136-4805-8968-f4226a76a155 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.017094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fb995-6136-4805-8968-f4226a76a155 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.022820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 141/270] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:15.022993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 129/270] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:15.023884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fb995-6136-4805-8968-f4226a76a155 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:15.024139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd1ec4-cb8b-4e2a-873e-2a52cf315ffa None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:15.111500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:15.163359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fb995-6136-4805-8968-f4226a76a155 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:15.203778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb515f-eb2f-45c1-8e28-725e2d20f9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:15.204505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb515f-eb2f-45c1-8e28-725e2d20f9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.204786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb515f-eb2f-45c1-8e28-725e2d20f9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.205096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb515f-eb2f-45c1-8e28-725e2d20f9c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.218042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb515f-eb2f-45c1-8e28-725e2d20f9c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:15.227394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd1ec4-cb8b-4e2a-873e-2a52cf315ffa None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-d7fb515f-eb2f-45c1-8e28-725e2d20f9c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:15.227552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:15.228362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:15.229196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 142/271] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:15.232866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a92ca-d2f6-4abe-b3e7-3437c7f37ce3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.232866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a92ca-d2f6-4abe-b3e7-3437c7f37ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.232866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a92ca-d2f6-4abe-b3e7-3437c7f37ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.253923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6e8a92ca-d2f6-4abe-b3e7-3437c7f37ce3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:15.256455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6e8a92ca-d2f6-4abe-b3e7-3437c7f37ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:15.269899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d744-c8aa-47ce-9fa9-8043491404d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:15.270892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d744-c8aa-47ce-9fa9-8043491404d8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.271171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d744-c8aa-47ce-9fa9-8043491404d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.271436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7d744-c8aa-47ce-9fa9-8043491404d8 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.272626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7d744-c8aa-47ce-9fa9-8043491404d8 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:15.274457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7d744-c8aa-47ce-9fa9-8043491404d8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:15.276621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 130/272] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:15 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:15.277540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d744-c8aa-47ce-9fa9-8043491404d8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:15.348499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 143/273] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:15.353838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a92ca-d2f6-4abe-b3e7-3437c7f37ce3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:15.373403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:15.418872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7d744-c8aa-47ce-9fa9-8043491404d8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:15.437553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:15.456061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f183da4-19d9-4536-99be-1635fc78f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:15.456691 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f183da4-19d9-4536-99be-1635fc78f78c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.457007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f183da4-19d9-4536-99be-1635fc78f78c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.457370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f183da4-19d9-4536-99be-1635fc78f78c None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.458225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f183da4-19d9-4536-99be-1635fc78f78c None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:15.458532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f183da4-19d9-4536-99be-1635fc78f78c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:15.459934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f183da4-19d9-4536-99be-1635fc78f78c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:15.469045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 131/274] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:15.470147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f183da4-19d9-4536-99be-1635fc78f78c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:15.492922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a92ca-d2f6-4abe-b3e7-3437c7f37ce3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:15.529726 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab13c-b9e5-467c-b6d5-79ed958d75e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:15.530554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab13c-b9e5-467c-b6d5-79ed958d75e7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.530840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab13c-b9e5-467c-b6d5-79ed958d75e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.531115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ab13c-b9e5-467c-b6d5-79ed958d75e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.532062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ab13c-b9e5-467c-b6d5-79ed958d75e7 None admin] RBAC: Adding query filter params (role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6, user.id=25c6dded5d8c4df8bb5a43f8f7f54677) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:15.532375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ab13c-b9e5-467c-b6d5-79ed958d75e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:15.533879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ab13c-b9e5-467c-b6d5-79ed958d75e7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:15.540862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 144/275] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:15 2022] GET /identity/v3/role_assignments?user.id=25c6dded5d8c4df8bb5a43f8f7f54677&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:15.542861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab13c-b9e5-467c-b6d5-79ed958d75e7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:15.604731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f183da4-19d9-4536-99be-1635fc78f78c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:15.661818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:15.668289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e8861-f861-465d-a929-089233b7c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:15.669002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ab13c-b9e5-467c-b6d5-79ed958d75e7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:15.669296 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8861-f861-465d-a929-089233b7c92c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.669583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8861-f861-465d-a929-089233b7c92c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.669857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e8861-f861-465d-a929-089233b7c92c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.676634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e8861-f861-465d-a929-089233b7c92c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:15.678245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e8861-f861-465d-a929-089233b7c92c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:15.680330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 132/276] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:15.686692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e8861-f861-465d-a929-089233b7c92c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:15.705618 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:15.730723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd420daa-5dc5-4727-9710-31e4ca33c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:15.731864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd420daa-5dc5-4727-9710-31e4ca33c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.732136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd420daa-5dc5-4727-9710-31e4ca33c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.732407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd420daa-5dc5-4727-9710-31e4ca33c1c4 None admin] PATH_INFO: `/v3/users/2ad765b8487b4b18b225036243b94aca` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.762483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd420daa-5dc5-4727-9710-31e4ca33c1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=2ad765b8487b4b18b225036243b94aca)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:15.764086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd420daa-5dc5-4727-9710-31e4ca33c1c4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:15.766105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 145/277] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:15 2022] GET /identity/v3/users/2ad765b8487b4b18b225036243b94aca => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:15.767218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b10305-132a-49c8-bca9-623f811e7db1 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.767499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b10305-132a-49c8-bca9-623f811e7db1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.767776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b10305-132a-49c8-bca9-623f811e7db1 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.769057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 146/278] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:15.773791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b10305-132a-49c8-bca9-623f811e7db1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:15.825718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e8861-f861-465d-a929-089233b7c92c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:15.864274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dc8aa-0964-4e9f-b039-b597321bda2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:15.864990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dc8aa-0964-4e9f-b039-b597321bda2e None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.865272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dc8aa-0964-4e9f-b039-b597321bda2e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.865543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dc8aa-0964-4e9f-b039-b597321bda2e None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.866249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dc8aa-0964-4e9f-b039-b597321bda2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:15.867730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dc8aa-0964-4e9f-b039-b597321bda2e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:15.889160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 133/279] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:15 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:15.890372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b10305-132a-49c8-bca9-623f811e7db1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:15.890584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34bda-666d-4fb1-9a4d-60a08c877075 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.891254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34bda-666d-4fb1-9a4d-60a08c877075 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.891612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34bda-666d-4fb1-9a4d-60a08c877075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.917842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-01f34bda-666d-4fb1-9a4d-60a08c877075 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:15.919185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-01f34bda-666d-4fb1-9a4d-60a08c877075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:15.945639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e927aa-6e7e-470a-aff3-98bbf34528fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:15.947102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e927aa-6e7e-470a-aff3-98bbf34528fc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:15.947887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e927aa-6e7e-470a-aff3-98bbf34528fc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:15.948376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e927aa-6e7e-470a-aff3-98bbf34528fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:15.950252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e927aa-6e7e-470a-aff3-98bbf34528fc None admin] RBAC: Adding query filter params (role.id=bd597f50c9ba47888ac496a996ba3b71, user.id=2ad765b8487b4b18b225036243b94aca, scope.system=all) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:15.950781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e927aa-6e7e-470a-aff3-98bbf34528fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:15.952899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e927aa-6e7e-470a-aff3-98bbf34528fc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:15.961643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 147/280] 10.222.0.59 () {56 vars in 1308 bytes} [Fri Jul 1 16:17:15 2022] GET /identity/v3/role_assignments?user.id=2ad765b8487b4b18b225036243b94aca&scope.system=all&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:15.985071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:16.008406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 134/281] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:16.032378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e927aa-6e7e-470a-aff3-98bbf34528fc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:16.079440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:16.149304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e927aa-6e7e-470a-aff3-98bbf34528fc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:16.184544 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa27c5-1aac-423a-9d90-a491695dc166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:16.185381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa27c5-1aac-423a-9d90-a491695dc166 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:16.185662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa27c5-1aac-423a-9d90-a491695dc166 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:16.185957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa27c5-1aac-423a-9d90-a491695dc166 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:16.196912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa27c5-1aac-423a-9d90-a491695dc166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b3fa27c5-1aac-423a-9d90-a491695dc166 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:16.204734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:16.205824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:16.206747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 148/282] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:16.211866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34bda-666d-4fb1-9a4d-60a08c877075 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:16.314719 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34bda-666d-4fb1-9a4d-60a08c877075 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:16.352780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e5441-3508-4705-8ae4-12d4b9d59fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:16.353507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e5441-3508-4705-8ae4-12d4b9d59fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:16.353786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e5441-3508-4705-8ae4-12d4b9d59fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:16.354055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e5441-3508-4705-8ae4-12d4b9d59fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:16.354819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e5441-3508-4705-8ae4-12d4b9d59fb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:16.355123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e5441-3508-4705-8ae4-12d4b9d59fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:16.356546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e5441-3508-4705-8ae4-12d4b9d59fb2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:16.366272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 135/283] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:16.371629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa27c5-1aac-423a-9d90-a491695dc166 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:16.485661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:16.492644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa27c5-1aac-423a-9d90-a491695dc166 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:16.538222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74be8f6-e02d-4879-99ea-91b8c94f607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:16.539111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74be8f6-e02d-4879-99ea-91b8c94f607a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:16.539388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74be8f6-e02d-4879-99ea-91b8c94f607a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:16.539665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74be8f6-e02d-4879-99ea-91b8c94f607a None admin] PATH_INFO: `/v3/users/aa1df54f31654fd9b54e8c671648eeeb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:16.540872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74be8f6-e02d-4879-99ea-91b8c94f607a None admin] RBAC: Authorizing `identity:get_user(user_id=aa1df54f31654fd9b54e8c671648eeeb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:16.542351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74be8f6-e02d-4879-99ea-91b8c94f607a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:16.544305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 149/284] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:16 2022] GET /identity/v3/users/aa1df54f31654fd9b54e8c671648eeeb => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:16.549817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e5441-3508-4705-8ae4-12d4b9d59fb2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:16.632527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:16.708621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e5441-3508-4705-8ae4-12d4b9d59fb2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:16.755628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67bbbf-ed57-432c-9422-b402a7c1b802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:16.756525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67bbbf-ed57-432c-9422-b402a7c1b802 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:16.756806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67bbbf-ed57-432c-9422-b402a7c1b802 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:16.757131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67bbbf-ed57-432c-9422-b402a7c1b802 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:16.765846 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67bbbf-ed57-432c-9422-b402a7c1b802 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:16.767349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67bbbf-ed57-432c-9422-b402a7c1b802 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:16.769172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 136/285] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:16 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:16.770461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f636d4-7475-4741-80bd-e1d392efd6b0 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:16.770753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f636d4-7475-4741-80bd-e1d392efd6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:16.771031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f636d4-7475-4741-80bd-e1d392efd6b0 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:16.772524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 150/286] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:16.777859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67bbbf-ed57-432c-9422-b402a7c1b802 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:16.782062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4414b4-36b8-4ec2-a9d9-1738924ee832 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:16.782349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4414b4-36b8-4ec2-a9d9-1738924ee832 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:16.782629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4414b4-36b8-4ec2-a9d9-1738924ee832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:16.833931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9a4414b4-36b8-4ec2-a9d9-1738924ee832 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:16.835142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9a4414b4-36b8-4ec2-a9d9-1738924ee832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:16.910486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67bbbf-ed57-432c-9422-b402a7c1b802 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:16.949218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:16.976357 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ace98-1c4f-4140-a765-1adf219a5f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:16.977306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ace98-1c4f-4140-a765-1adf219a5f90 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:16.977868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ace98-1c4f-4140-a765-1adf219a5f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:16.978156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ace98-1c4f-4140-a765-1adf219a5f90 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/users/aa1df54f31654fd9b54e8c671648eeeb/roles/554f851c7f784bbc9dc162466570cb20` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:16.981004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ace98-1c4f-4140-a765-1adf219a5f90 None admin] RBAC: Authorizing `identity:create_grant(project_id=698dfbe68a2342439db4f2b52c2b34a6, user_id=aa1df54f31654fd9b54e8c671648eeeb, role_id=554f851c7f784bbc9dc162466570cb20)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:16.984426 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 151/287] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:16.984749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ace98-1c4f-4140-a765-1adf219a5f90 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:17.010003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4414b4-36b8-4ec2-a9d9-1738924ee832 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:17.030146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 137/288] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:16 2022] PUT /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/users/aa1df54f31654fd9b54e8c671648eeeb/roles/554f851c7f784bbc9dc162466570cb20 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:17.159343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:17.171431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4414b4-36b8-4ec2-a9d9-1738924ee832 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:17.215317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8851a1-1773-4f4f-add8-5efd5f9daf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:17.216139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8851a1-1773-4f4f-add8-5efd5f9daf97 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:17.216422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8851a1-1773-4f4f-add8-5efd5f9daf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:17.216699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8851a1-1773-4f4f-add8-5efd5f9daf97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:17.227868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8851a1-1773-4f4f-add8-5efd5f9daf97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-1d8851a1-1773-4f4f-add8-5efd5f9daf97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:17.236095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:17.236974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:17.237799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:17.240956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 152/289] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:17.243581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ace98-1c4f-4140-a765-1adf219a5f90 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:17.350983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ace98-1c4f-4140-a765-1adf219a5f90 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:17.391968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4513c-abbe-43be-98a9-f95e4803375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:17.392655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4513c-abbe-43be-98a9-f95e4803375d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:17.392963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4513c-abbe-43be-98a9-f95e4803375d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:17.393245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4513c-abbe-43be-98a9-f95e4803375d None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:17.394009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4513c-abbe-43be-98a9-f95e4803375d None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:17.394320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4513c-abbe-43be-98a9-f95e4803375d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:17.395729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c4513c-abbe-43be-98a9-f95e4803375d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:17.404697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 138/290] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:17.410243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8851a1-1773-4f4f-add8-5efd5f9daf97 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:17.542341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8851a1-1773-4f4f-add8-5efd5f9daf97 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:17.588045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ed2d-bf44-428f-a93d-b51d2463cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:17.588963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ed2d-bf44-428f-a93d-b51d2463cf9b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:17.589251 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ed2d-bf44-428f-a93d-b51d2463cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:17.589529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48ed2d-bf44-428f-a93d-b51d2463cf9b None admin] PATH_INFO: `/v3/users/e0d661191cde45bb861f3e0ddb57ef10` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:17.590759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ed2d-bf44-428f-a93d-b51d2463cf9b None admin] RBAC: Authorizing `identity:get_user(user_id=e0d661191cde45bb861f3e0ddb57ef10)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:17.592219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48ed2d-bf44-428f-a93d-b51d2463cf9b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:17.594125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 153/291] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:17 2022] GET /identity/v3/users/e0d661191cde45bb861f3e0ddb57ef10 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:17.599658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4513c-abbe-43be-98a9-f95e4803375d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:17.657782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:17.742332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c4513c-abbe-43be-98a9-f95e4803375d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:17.787898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4431fe-dc45-4960-b5a6-2428f6c4b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:17.788572 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4431fe-dc45-4960-b5a6-2428f6c4b216 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:17.788874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4431fe-dc45-4960-b5a6-2428f6c4b216 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:17.789167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4431fe-dc45-4960-b5a6-2428f6c4b216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:17.874243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4431fe-dc45-4960-b5a6-2428f6c4b216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:17.875813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4431fe-dc45-4960-b5a6-2428f6c4b216 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:17.917907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:18.012394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 139/292] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:18.017882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ed2d-bf44-428f-a93d-b51d2463cf9b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:18.069235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:18.171639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48ed2d-bf44-428f-a93d-b51d2463cf9b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:18.224267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c5a8a-32ab-4cac-b5d4-73f769c2d298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:18.225173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5a8a-32ab-4cac-b5d4-73f769c2d298 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.225459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5a8a-32ab-4cac-b5d4-73f769c2d298 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.225736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c5a8a-32ab-4cac-b5d4-73f769c2d298 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.226992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5a8a-32ab-4cac-b5d4-73f769c2d298 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:18.228469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c5a8a-32ab-4cac-b5d4-73f769c2d298 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:18.230387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 154/293] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:18 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:18.236554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4431fe-dc45-4960-b5a6-2428f6c4b216 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:18.370901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4431fe-dc45-4960-b5a6-2428f6c4b216 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:18.415863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a943faff-3bb2-41ec-96f7-5caf10d501a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:18.416544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943faff-3bb2-41ec-96f7-5caf10d501a5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.416827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943faff-3bb2-41ec-96f7-5caf10d501a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.417127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a943faff-3bb2-41ec-96f7-5caf10d501a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.417972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943faff-3bb2-41ec-96f7-5caf10d501a5 None admin] RBAC: Adding query filter params (role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6, user.id=e0d661191cde45bb861f3e0ddb57ef10) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:18.418413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943faff-3bb2-41ec-96f7-5caf10d501a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:18.420555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a943faff-3bb2-41ec-96f7-5caf10d501a5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:18.423871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:18.427122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 140/294] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:18 2022] GET /identity/v3/role_assignments?user.id=e0d661191cde45bb861f3e0ddb57ef10&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:18.462437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b9c2b-e34f-42f6-9242-37eb499028f1 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.462969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b9c2b-e34f-42f6-9242-37eb499028f1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.463412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b9c2b-e34f-42f6-9242-37eb499028f1 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.465377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 155/295] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:18.471391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ce9e2-9732-4fbc-ae0d-ace109db7f43 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.471899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ce9e2-9732-4fbc-ae0d-ace109db7f43 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.472316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ce9e2-9732-4fbc-ae0d-ace109db7f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.491185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-773ce9e2-9732-4fbc-ae0d-ace109db7f43 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:18.492419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-773ce9e2-9732-4fbc-ae0d-ace109db7f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:18.535332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ee873-4b3a-4c94-b3f4-15e5d1e29d75 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.535665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ee873-4b3a-4c94-b3f4-15e5d1e29d75 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.536252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ee873-4b3a-4c94-b3f4-15e5d1e29d75 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.537600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 156/296] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:18.546773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88731f4-c32b-46f1-b109-38fa98d33054 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.547835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88731f4-c32b-46f1-b109-38fa98d33054 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.548207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88731f4-c32b-46f1-b109-38fa98d33054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.580451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b88731f4-c32b-46f1-b109-38fa98d33054 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:18.581692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b88731f4-c32b-46f1-b109-38fa98d33054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:18.592214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 141/297] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:18.600692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e688b-d0c1-4e53-b06f-50fed6f9d89e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.601331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e688b-d0c1-4e53-b06f-50fed6f9d89e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.601331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e688b-d0c1-4e53-b06f-50fed6f9d89e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.602842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 142/298] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:18.608675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187e335-c924-4ed2-b5c0-0566f6d96877 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.609150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187e335-c924-4ed2-b5c0-0566f6d96877 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.609430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187e335-c924-4ed2-b5c0-0566f6d96877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.632062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b187e335-c924-4ed2-b5c0-0566f6d96877 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:18.633306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b187e335-c924-4ed2-b5c0-0566f6d96877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:18.674934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 157/299] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:18.676112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88731f4-c32b-46f1-b109-38fa98d33054 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:18.705486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:18.716647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 143/300] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:18.717446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187e335-c924-4ed2-b5c0-0566f6d96877 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:18.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:18.810048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88731f4-c32b-46f1-b109-38fa98d33054 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:18.839008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187e335-c924-4ed2-b5c0-0566f6d96877 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:18.847606 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bdfc3-1047-49b7-8e5c-f538f4e4729c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:18.848410 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bdfc3-1047-49b7-8e5c-f538f4e4729c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.848696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bdfc3-1047-49b7-8e5c-f538f4e4729c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.849008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bdfc3-1047-49b7-8e5c-f538f4e4729c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.859464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bdfc3-1047-49b7-8e5c-f538f4e4729c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-652bdfc3-1047-49b7-8e5c-f538f4e4729c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:18.867133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:18.868024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:18.868802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 158/301] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:18.869493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bdfc3-1047-49b7-8e5c-f538f4e4729c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:18.881425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fe123-c84c-4655-a070-63741f580b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:18.882349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe123-c84c-4655-a070-63741f580b20 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:18.882630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe123-c84c-4655-a070-63741f580b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:18.882903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fe123-c84c-4655-a070-63741f580b20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:18.894180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fe123-c84c-4655-a070-63741f580b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f95fe123-c84c-4655-a070-63741f580b20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:18.902326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:18.903202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:18.903967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 144/302] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:18.904620 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fe123-c84c-4655-a070-63741f580b20 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:18.963587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:18.982528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bdfc3-1047-49b7-8e5c-f538f4e4729c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:19.008741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fe123-c84c-4655-a070-63741f580b20 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:19.016394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c407904-2244-4421-8d29-787b3b3e010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:19.017254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c407904-2244-4421-8d29-787b3b3e010a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.017535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c407904-2244-4421-8d29-787b3b3e010a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.017808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c407904-2244-4421-8d29-787b3b3e010a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.018968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c407904-2244-4421-8d29-787b3b3e010a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:19.020421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c407904-2244-4421-8d29-787b3b3e010a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:19.022072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 159/303] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:19.027314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c407904-2244-4421-8d29-787b3b3e010a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:19.031301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:19.045743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd014e29-b458-4383-95c0-51ccd1015fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:19.046607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd014e29-b458-4383-95c0-51ccd1015fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.047098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd014e29-b458-4383-95c0-51ccd1015fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.047511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd014e29-b458-4383-95c0-51ccd1015fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.048401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd014e29-b458-4383-95c0-51ccd1015fb0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:19.048888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd014e29-b458-4383-95c0-51ccd1015fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:19.050507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd014e29-b458-4383-95c0-51ccd1015fb0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:19.059937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 145/304] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:19.060905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd014e29-b458-4383-95c0-51ccd1015fb0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:19.133968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c407904-2244-4421-8d29-787b3b3e010a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:19.162686 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd014e29-b458-4383-95c0-51ccd1015fb0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:19.168877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43951fce-fc1b-4ca5-9a8d-261996b6d20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:19.169648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43951fce-fc1b-4ca5-9a8d-261996b6d20e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.169923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43951fce-fc1b-4ca5-9a8d-261996b6d20e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.170219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43951fce-fc1b-4ca5-9a8d-261996b6d20e None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.170965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43951fce-fc1b-4ca5-9a8d-261996b6d20e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:19.171267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43951fce-fc1b-4ca5-9a8d-261996b6d20e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:19.172870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43951fce-fc1b-4ca5-9a8d-261996b6d20e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:19.181889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 160/305] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:19.186899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43951fce-fc1b-4ca5-9a8d-261996b6d20e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:19.197250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a8c75-6874-41d4-a34a-437592144f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:19.198128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a8c75-6874-41d4-a34a-437592144f5e None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.198413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a8c75-6874-41d4-a34a-437592144f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.198694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a8c75-6874-41d4-a34a-437592144f5e None admin] PATH_INFO: `/v3/groups` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.199381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a8c75-6874-41d4-a34a-437592144f5e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:19.200869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a8c75-6874-41d4-a34a-437592144f5e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:19.201595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:19.217702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 146/306] 10.222.0.59 () {60 vars in 1134 bytes} [Fri Jul 1 16:17:19 2022] POST /identity/v3/groups => generated 229 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:19.219484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a8c75-6874-41d4-a34a-437592144f5e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:19.293288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:19.333590 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43951fce-fc1b-4ca5-9a8d-261996b6d20e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:19.333974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a8c75-6874-41d4-a34a-437592144f5e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:19.371200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6a347-c3c0-4504-ab05-735049d72d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:19.372108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6a347-c3c0-4504-ab05-735049d72d2e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.372382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6a347-c3c0-4504-ab05-735049d72d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.372656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6a347-c3c0-4504-ab05-735049d72d2e None admin] PATH_INFO: `/v3/users/47461d59f1cd4cc697faef59eb11364e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.386120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39589f-c13d-412b-8302-f5eab566b835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:19.387383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39589f-c13d-412b-8302-f5eab566b835 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.387832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39589f-c13d-412b-8302-f5eab566b835 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.388358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec39589f-c13d-412b-8302-f5eab566b835 None admin] PATH_INFO: `/v3/users/2ad765b8487b4b18b225036243b94aca` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.389867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39589f-c13d-412b-8302-f5eab566b835 None admin] RBAC: Authorizing `identity:get_user(user_id=2ad765b8487b4b18b225036243b94aca)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:19.390337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6a347-c3c0-4504-ab05-735049d72d2e None admin] RBAC: Authorizing `identity:get_user(user_id=47461d59f1cd4cc697faef59eb11364e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:19.391741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec39589f-c13d-412b-8302-f5eab566b835 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:19.391969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6a347-c3c0-4504-ab05-735049d72d2e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:19.393794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 161/307] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:19 2022] GET /identity/v3/users/2ad765b8487b4b18b225036243b94aca => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:19.397115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 147/308] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:19 2022] GET /identity/v3/users/47461d59f1cd4cc697faef59eb11364e => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:19.403062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39589f-c13d-412b-8302-f5eab566b835 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:19.404305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6a347-c3c0-4504-ab05-735049d72d2e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:19.509220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:19.521432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:19.527489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6a347-c3c0-4504-ab05-735049d72d2e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:19.531003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec39589f-c13d-412b-8302-f5eab566b835 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:19.570388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004815-1aee-45a6-9a99-0051cc18ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:19.571059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004815-1aee-45a6-9a99-0051cc18ac4b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.571342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004815-1aee-45a6-9a99-0051cc18ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.571567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10e470-a253-4b06-bdee-a147892a3dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:19.572013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004815-1aee-45a6-9a99-0051cc18ac4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.572441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004815-1aee-45a6-9a99-0051cc18ac4b None admin] RBAC: Adding query filter params (role.id=554f851c7f784bbc9dc162466570cb20, user.id=47461d59f1cd4cc697faef59eb11364e, scope.system=all) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:19.572753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004815-1aee-45a6-9a99-0051cc18ac4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:19.573610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10e470-a253-4b06-bdee-a147892a3dfc None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.574086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10e470-a253-4b06-bdee-a147892a3dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.574249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004815-1aee-45a6-9a99-0051cc18ac4b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:19.574699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10e470-a253-4b06-bdee-a147892a3dfc None admin] PATH_INFO: `/v3/system/users/2ad765b8487b4b18b225036243b94aca/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.576642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10e470-a253-4b06-bdee-a147892a3dfc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2ad765b8487b4b18b225036243b94aca, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:19.578320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10e470-a253-4b06-bdee-a147892a3dfc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:19.579432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 148/309] 10.222.0.59 () {56 vars in 1308 bytes} [Fri Jul 1 16:17:19 2022] GET /identity/v3/role_assignments?user.id=47461d59f1cd4cc697faef59eb11364e&scope.system=all&role.id=554f851c7f784bbc9dc162466570cb20 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:19.596155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 162/310] 10.222.0.59 () {58 vars in 1334 bytes} [Fri Jul 1 16:17:19 2022] PUT /identity/v3/system/users/2ad765b8487b4b18b225036243b94aca/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:17:19.719507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a607b-c961-49e4-92be-567160e57638 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.720554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a607b-c961-49e4-92be-567160e57638 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.721093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a607b-c961-49e4-92be-567160e57638 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.722849 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 149/311] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:19.729250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf9846-2410-4db0-b655-f301189063ab None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:19.729891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf9846-2410-4db0-b655-f301189063ab None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:19.730365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf9846-2410-4db0-b655-f301189063ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:19.750170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8cdf9846-2410-4db0-b655-f301189063ab None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:19.751497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8cdf9846-2410-4db0-b655-f301189063ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:19.824279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 163/312] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:19.850045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a607b-c961-49e4-92be-567160e57638 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:19.972111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a607b-c961-49e4-92be-567160e57638 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:20.007662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4c1f-938c-4f1f-86be-50cdc1b3a892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:20.008835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4c1f-938c-4f1f-86be-50cdc1b3a892 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:20.009355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4c1f-938c-4f1f-86be-50cdc1b3a892 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:20.009823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4c1f-938c-4f1f-86be-50cdc1b3a892 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:20.020802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db4c1f-938c-4f1f-86be-50cdc1b3a892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-45db4c1f-938c-4f1f-86be-50cdc1b3a892 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:20.028802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:20.029672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:20.030585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:20.033043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 150/313] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:20.044889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf9846-2410-4db0-b655-f301189063ab None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:20.113027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:20.137625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf9846-2410-4db0-b655-f301189063ab None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:20.173029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6427ef9-a847-44aa-bd80-4880c6193ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:20.173741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6427ef9-a847-44aa-bd80-4880c6193ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:20.174420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6427ef9-a847-44aa-bd80-4880c6193ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:20.174687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6427ef9-a847-44aa-bd80-4880c6193ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:20.175430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6427ef9-a847-44aa-bd80-4880c6193ea3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:20.175731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6427ef9-a847-44aa-bd80-4880c6193ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:20.177363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6427ef9-a847-44aa-bd80-4880c6193ea3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:20.188732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 164/314] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:20.196677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4c1f-938c-4f1f-86be-50cdc1b3a892 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:20.222400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:20.298362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4c1f-938c-4f1f-86be-50cdc1b3a892 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:20.331616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caae3d-ca2a-449e-b35e-ba086b7e8731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:20.332507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caae3d-ca2a-449e-b35e-ba086b7e8731 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:20.332785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caae3d-ca2a-449e-b35e-ba086b7e8731 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:20.333098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caae3d-ca2a-449e-b35e-ba086b7e8731 None admin] PATH_INFO: `/v3/users/aa1df54f31654fd9b54e8c671648eeeb` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:20.334349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caae3d-ca2a-449e-b35e-ba086b7e8731 None admin] RBAC: Authorizing `identity:get_user(user_id=aa1df54f31654fd9b54e8c671648eeeb)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:20.335813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caae3d-ca2a-449e-b35e-ba086b7e8731 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:20.337469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 151/315] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:20 2022] GET /identity/v3/users/aa1df54f31654fd9b54e8c671648eeeb => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:20.343114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6427ef9-a847-44aa-bd80-4880c6193ea3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:20.447645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6427ef9-a847-44aa-bd80-4880c6193ea3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:20.482598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047bd2e-1106-4d88-b8ed-d4807560582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:20.483798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047bd2e-1106-4d88-b8ed-d4807560582e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:20.484220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047bd2e-1106-4d88-b8ed-d4807560582e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:20.484499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047bd2e-1106-4d88-b8ed-d4807560582e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:20.488163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:20.552808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047bd2e-1106-4d88-b8ed-d4807560582e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:20.554304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047bd2e-1106-4d88-b8ed-d4807560582e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:20.651173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 165/316] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:20.656867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caae3d-ca2a-449e-b35e-ba086b7e8731 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:20.757870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:20.767898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caae3d-ca2a-449e-b35e-ba086b7e8731 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:20.805649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a0cc0-d2d9-4446-9e28-3c15fb7a9a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:20.806536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a0cc0-d2d9-4446-9e28-3c15fb7a9a5a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:20.806815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a0cc0-d2d9-4446-9e28-3c15fb7a9a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:20.807091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a0cc0-d2d9-4446-9e28-3c15fb7a9a5a None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:20.808292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a0cc0-d2d9-4446-9e28-3c15fb7a9a5a None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:20.809826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a0cc0-d2d9-4446-9e28-3c15fb7a9a5a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:20.811540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 152/317] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:20 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:20.817499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047bd2e-1106-4d88-b8ed-d4807560582e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:20.852782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:20.922243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047bd2e-1106-4d88-b8ed-d4807560582e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:20.956759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a99a5-da88-4d09-be19-64aa1e9136d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:20.957454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a99a5-da88-4d09-be19-64aa1e9136d9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:20.957739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a99a5-da88-4d09-be19-64aa1e9136d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:20.958014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a99a5-da88-4d09-be19-64aa1e9136d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:20.958853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a99a5-da88-4d09-be19-64aa1e9136d9 None admin] RBAC: Adding query filter params (role.id=554f851c7f784bbc9dc162466570cb20, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6, user.id=aa1df54f31654fd9b54e8c671648eeeb) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:20.959163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a99a5-da88-4d09-be19-64aa1e9136d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:20.960630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a99a5-da88-4d09-be19-64aa1e9136d9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:20.967133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 166/318] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:20 2022] GET /identity/v3/role_assignments?user.id=aa1df54f31654fd9b54e8c671648eeeb&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=554f851c7f784bbc9dc162466570cb20 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:21.335180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be1115-ef47-4b0d-9325-0f87696093f4 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:21.335582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be1115-ef47-4b0d-9325-0f87696093f4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:21.335805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be1115-ef47-4b0d-9325-0f87696093f4 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:21.337274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 153/319] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:21.342608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd88d0-033e-4920-8968-b0eac3a3645a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:21.342862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd88d0-033e-4920-8968-b0eac3a3645a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:21.343160 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd88d0-033e-4920-8968-b0eac3a3645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:21.360421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fbcd88d0-033e-4920-8968-b0eac3a3645a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:21.361628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fbcd88d0-033e-4920-8968-b0eac3a3645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:21.432206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 167/320] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:21.454688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be1115-ef47-4b0d-9325-0f87696093f4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:21.566131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be1115-ef47-4b0d-9325-0f87696093f4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:21.600522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01c5e2-c456-41e3-9e0d-e5d88412fdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:21.601274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01c5e2-c456-41e3-9e0d-e5d88412fdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:21.601558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01c5e2-c456-41e3-9e0d-e5d88412fdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:21.601827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01c5e2-c456-41e3-9e0d-e5d88412fdc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:21.602996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01c5e2-c456-41e3-9e0d-e5d88412fdc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:21.604483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01c5e2-c456-41e3-9e0d-e5d88412fdc3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:21.606299 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 154/321] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:21.612322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd88d0-033e-4920-8968-b0eac3a3645a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:21.643531 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:21.705710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706bdb2-8e92-4cf2-bed6-aae1801490ab None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:21.706549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706bdb2-8e92-4cf2-bed6-aae1801490ab None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:21.706833 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706bdb2-8e92-4cf2-bed6-aae1801490ab None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:21.708915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 155/322] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:21.713773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706618b-a119-4e2d-b16f-5607d916d757 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:21.714317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706618b-a119-4e2d-b16f-5607d916d757 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:21.714597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706618b-a119-4e2d-b16f-5607d916d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:21.718691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd88d0-033e-4920-8968-b0eac3a3645a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:21.731957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5706618b-a119-4e2d-b16f-5607d916d757 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:21.733555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5706618b-a119-4e2d-b16f-5607d916d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:21.757628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9323a7-5502-4a4c-868a-50347aab01f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:21.758030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:21.758451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9323a7-5502-4a4c-868a-50347aab01f7 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:21.758527 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9323a7-5502-4a4c-868a-50347aab01f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:21.758832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9323a7-5502-4a4c-868a-50347aab01f7 None admin] PATH_INFO: `/v3/groups` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:21.759577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9323a7-5502-4a4c-868a-50347aab01f7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:21.761202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9323a7-5502-4a4c-868a-50347aab01f7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:21.778516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 168/323] 10.222.0.59 () {60 vars in 1134 bytes} [Fri Jul 1 16:17:21 2022] POST /identity/v3/groups => generated 226 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:21.779818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff3199-fc23-4664-b854-0c1e08d86415 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:21.780107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff3199-fc23-4664-b854-0c1e08d86415 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:21.780382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff3199-fc23-4664-b854-0c1e08d86415 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:21.781687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 169/324] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:21.787523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7625952-5516-4850-98cd-abf18bcea5c2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:21.787810 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7625952-5516-4850-98cd-abf18bcea5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:21.788083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7625952-5516-4850-98cd-abf18bcea5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:21.805972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d7625952-5516-4850-98cd-abf18bcea5c2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:21.807242 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d7625952-5516-4850-98cd-abf18bcea5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:21.826215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 156/325] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:21.849465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706618b-a119-4e2d-b16f-5607d916d757 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:21.887803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 170/326] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:21.910443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7625952-5516-4850-98cd-abf18bcea5c2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:21.933986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:21.973172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706618b-a119-4e2d-b16f-5607d916d757 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:22.013987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994aaf-7f2e-4dec-adc2-ada971dce66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:22.016645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994aaf-7f2e-4dec-adc2-ada971dce66e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:22.016645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994aaf-7f2e-4dec-adc2-ada971dce66e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:22.016645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f994aaf-7f2e-4dec-adc2-ada971dce66e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:22.029927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7625952-5516-4850-98cd-abf18bcea5c2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:22.030167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f994aaf-7f2e-4dec-adc2-ada971dce66e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8f994aaf-7f2e-4dec-adc2-ada971dce66e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:22.038091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:22.039009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:22.039795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 157/327] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:22.045630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994aaf-7f2e-4dec-adc2-ada971dce66e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:22.068598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:22.074048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f955-93a3-4ab3-b7e4-8eec673f58fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:22.074854 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f955-93a3-4ab3-b7e4-8eec673f58fa None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:22.075141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f955-93a3-4ab3-b7e4-8eec673f58fa None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:22.075407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79f955-93a3-4ab3-b7e4-8eec673f58fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:22.088836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79f955-93a3-4ab3-b7e4-8eec673f58fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-df79f955-93a3-4ab3-b7e4-8eec673f58fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:22.096654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:22.097591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:22.098359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 171/328] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:22.103738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f955-93a3-4ab3-b7e4-8eec673f58fa None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:22.176662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f994aaf-7f2e-4dec-adc2-ada971dce66e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:22.210010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:22.221650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d731d-6eeb-41c7-91fc-bc759f115356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:22.222976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d731d-6eeb-41c7-91fc-bc759f115356 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:22.223694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d731d-6eeb-41c7-91fc-bc759f115356 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:22.224184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d731d-6eeb-41c7-91fc-bc759f115356 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:22.225436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d731d-6eeb-41c7-91fc-bc759f115356 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:22.226271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d731d-6eeb-41c7-91fc-bc759f115356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:22.227907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d731d-6eeb-41c7-91fc-bc759f115356 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:22.238134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 158/329] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:22.238312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79f955-93a3-4ab3-b7e4-8eec673f58fa None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:22.244631 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d731d-6eeb-41c7-91fc-bc759f115356 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:22.281620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67d24a-4dd5-4fcd-b7db-46063f01accb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:22.282795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67d24a-4dd5-4fcd-b7db-46063f01accb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:22.282795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67d24a-4dd5-4fcd-b7db-46063f01accb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:22.282960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67d24a-4dd5-4fcd-b7db-46063f01accb None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:22.283626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67d24a-4dd5-4fcd-b7db-46063f01accb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:22.283932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67d24a-4dd5-4fcd-b7db-46063f01accb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:22.285374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67d24a-4dd5-4fcd-b7db-46063f01accb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:22.294984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 172/330] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:22.302555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67d24a-4dd5-4fcd-b7db-46063f01accb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:22.347732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:22.374625 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d731d-6eeb-41c7-91fc-bc759f115356 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:22.425475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de724cbd-8277-4744-893b-0de22e15c259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:22.427178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de724cbd-8277-4744-893b-0de22e15c259 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:22.427660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de724cbd-8277-4744-893b-0de22e15c259 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:22.428130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de724cbd-8277-4744-893b-0de22e15c259 None admin] PATH_INFO: `/v3/users/2ad765b8487b4b18b225036243b94aca` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:22.430029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de724cbd-8277-4744-893b-0de22e15c259 None admin] RBAC: Authorizing `identity:get_user(user_id=2ad765b8487b4b18b225036243b94aca)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:22.432159 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de724cbd-8277-4744-893b-0de22e15c259 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:22.434854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 159/331] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:22 2022] GET /identity/v3/users/2ad765b8487b4b18b225036243b94aca => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:22.441664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de724cbd-8277-4744-893b-0de22e15c259 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:22.445744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67d24a-4dd5-4fcd-b7db-46063f01accb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:22.490374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4f19-f309-468f-ada0-d236d724d5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:22.492152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4f19-f309-468f-ada0-d236d724d5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:22.492629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4f19-f309-468f-ada0-d236d724d5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:22.493609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde4f19-f309-468f-ada0-d236d724d5a4 None admin] PATH_INFO: `/v3/users/47461d59f1cd4cc697faef59eb11364e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:22.496423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4f19-f309-468f-ada0-d236d724d5a4 None admin] RBAC: Authorizing `identity:get_user(user_id=47461d59f1cd4cc697faef59eb11364e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:22.498538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde4f19-f309-468f-ada0-d236d724d5a4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:22.501705 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 173/332] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:22 2022] GET /identity/v3/users/47461d59f1cd4cc697faef59eb11364e => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:22.508090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4f19-f309-468f-ada0-d236d724d5a4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:22.526702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:22.613805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de724cbd-8277-4744-893b-0de22e15c259 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:22.631331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde4f19-f309-468f-ada0-d236d724d5a4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:22.671098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e820-b012-405c-822f-217b11c70d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:22.672259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b7fcb-d67b-401c-99bc-6671ee2a256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:22.672800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e820-b012-405c-822f-217b11c70d3f None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:22.672932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7fcb-d67b-401c-99bc-6671ee2a256c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:22.673228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7fcb-d67b-401c-99bc-6671ee2a256c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:22.673505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b7fcb-d67b-401c-99bc-6671ee2a256c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:22.673848 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e820-b012-405c-822f-217b11c70d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:22.674308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e820-b012-405c-822f-217b11c70d3f None admin] PATH_INFO: `/v3/system/users/47461d59f1cd4cc697faef59eb11364e/roles/554f851c7f784bbc9dc162466570cb20` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:22.674405 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b7fcb-d67b-401c-99bc-6671ee2a256c None admin] RBAC: Adding query filter params (role.id=bd597f50c9ba47888ac496a996ba3b71, user.id=2ad765b8487b4b18b225036243b94aca, scope.system=all) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:22.674648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b7fcb-d67b-401c-99bc-6671ee2a256c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:22.676273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b7fcb-d67b-401c-99bc-6671ee2a256c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:22.676559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e820-b012-405c-822f-217b11c70d3f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=47461d59f1cd4cc697faef59eb11364e, role_id=554f851c7f784bbc9dc162466570cb20)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:22.678383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e820-b012-405c-822f-217b11c70d3f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:22.691759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 174/333] 10.222.0.59 () {58 vars in 1334 bytes} [Fri Jul 1 16:17:22 2022] PUT /identity/v3/system/users/47461d59f1cd4cc697faef59eb11364e/roles/554f851c7f784bbc9dc162466570cb20 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:17:22.696714 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 160/334] 10.222.0.59 () {56 vars in 1308 bytes} [Fri Jul 1 16:17:22 2022] GET /identity/v3/role_assignments?user.id=2ad765b8487b4b18b225036243b94aca&scope.system=all&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 510 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:24.455755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e2cbd-6212-4f9c-8eac-8d03096e2069 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:24.456723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e2cbd-6212-4f9c-8eac-8d03096e2069 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:24.457230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e2cbd-6212-4f9c-8eac-8d03096e2069 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:24.458819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 175/335] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:24.476710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c5f20-3583-4fed-991d-176b3b852e84 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:24.477634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c5f20-3583-4fed-991d-176b3b852e84 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:24.478070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c5f20-3583-4fed-991d-176b3b852e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:24.491275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:24.503039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-651c5f20-3583-4fed-991d-176b3b852e84 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:24.504657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-651c5f20-3583-4fed-991d-176b3b852e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:24.577652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 161/336] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:24.582282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479e2b-2540-43c9-b5ab-66a9561c872f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:24.582787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479e2b-2540-43c9-b5ab-66a9561c872f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:24.583260 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb479e2b-2540-43c9-b5ab-66a9561c872f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:24.584867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 176/337] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:24.590241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196e66-7ea4-437d-8fd8-df80f02b7d26 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:24.590745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196e66-7ea4-437d-8fd8-df80f02b7d26 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:24.591212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a196e66-7ea4-437d-8fd8-df80f02b7d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:24.602207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479e2b-2540-43c9-b5ab-66a9561c872f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:24.625032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9a196e66-7ea4-437d-8fd8-df80f02b7d26 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:24.626598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9a196e66-7ea4-437d-8fd8-df80f02b7d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:24.742363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:24.790548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 162/338] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:24.822542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb479e2b-2540-43c9-b5ab-66a9561c872f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:24.852671 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196e66-7ea4-437d-8fd8-df80f02b7d26 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:24.882487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61d28b-c2b9-4350-a402-63b7d29277c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:24.883311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61d28b-c2b9-4350-a402-63b7d29277c7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:24.883594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61d28b-c2b9-4350-a402-63b7d29277c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:24.883868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61d28b-c2b9-4350-a402-63b7d29277c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:24.913844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61d28b-c2b9-4350-a402-63b7d29277c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-fe61d28b-c2b9-4350-a402-63b7d29277c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:24.921730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:24.922598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:24.923377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:24.927830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 177/339] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:24.932408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61d28b-c2b9-4350-a402-63b7d29277c7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:24.958226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:24.992265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a196e66-7ea4-437d-8fd8-df80f02b7d26 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:25.048072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae4d3-45d2-42cf-810c-3d5610cf31b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:25.048942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae4d3-45d2-42cf-810c-3d5610cf31b8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.049222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae4d3-45d2-42cf-810c-3d5610cf31b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.049493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae4d3-45d2-42cf-810c-3d5610cf31b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.066426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cae4d3-45d2-42cf-810c-3d5610cf31b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-23cae4d3-45d2-42cf-810c-3d5610cf31b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:25.080399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:25.081520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:25.082488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:25.084834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 163/340] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:25.106099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61d28b-c2b9-4350-a402-63b7d29277c7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:25.109233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae4d3-45d2-42cf-810c-3d5610cf31b8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:25.160275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec55d4f-f2fa-460d-963d-dce9c555207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:25.161258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec55d4f-f2fa-460d-963d-dce9c555207c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.161684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec55d4f-f2fa-460d-963d-dce9c555207c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.162100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec55d4f-f2fa-460d-963d-dce9c555207c None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.163026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec55d4f-f2fa-460d-963d-dce9c555207c None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:25.163490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec55d4f-f2fa-460d-963d-dce9c555207c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:25.165064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec55d4f-f2fa-460d-963d-dce9c555207c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:25.172869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:25.181674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 178/341] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:25.194001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec55d4f-f2fa-460d-963d-dce9c555207c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:25.255563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae4d3-45d2-42cf-810c-3d5610cf31b8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:25.305037 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:25.314638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a82b83-b705-4c24-9529-d0af2b45d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:25.315349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82b83-b705-4c24-9529-d0af2b45d99d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.315636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82b83-b705-4c24-9529-d0af2b45d99d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.315907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82b83-b705-4c24-9529-d0af2b45d99d None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.316682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a82b83-b705-4c24-9529-d0af2b45d99d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:25.317015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a82b83-b705-4c24-9529-d0af2b45d99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:25.318419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a82b83-b705-4c24-9529-d0af2b45d99d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:25.332288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 164/342] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:25.338103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a82b83-b705-4c24-9529-d0af2b45d99d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:25.389186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec55d4f-f2fa-460d-963d-dce9c555207c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:25.444696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5d70f-2282-4ada-a1e4-798205d438dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:25.445869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d70f-2282-4ada-a1e4-798205d438dd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.446357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d70f-2282-4ada-a1e4-798205d438dd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.446819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5d70f-2282-4ada-a1e4-798205d438dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.463740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a82b83-b705-4c24-9529-d0af2b45d99d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:25.504992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548b3b8-d9b1-4431-bdff-b90a3b36e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:25.506428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548b3b8-d9b1-4431-bdff-b90a3b36e90c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.506871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548b3b8-d9b1-4431-bdff-b90a3b36e90c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.507280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548b3b8-d9b1-4431-bdff-b90a3b36e90c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.561232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:25.571475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5d70f-2282-4ada-a1e4-798205d438dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:25.572979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5d70f-2282-4ada-a1e4-798205d438dd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:25.614771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:25.631385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548b3b8-d9b1-4431-bdff-b90a3b36e90c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:25.632888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548b3b8-d9b1-4431-bdff-b90a3b36e90c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:25.724455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 179/343] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 16:17:25.726194 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec945f0-c08e-49a8-aa08-400e877eaf28 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.726701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec945f0-c08e-49a8-aa08-400e877eaf28 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.727163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec945f0-c08e-49a8-aa08-400e877eaf28 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.728975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 180/344] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:25.730309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324a654-ef8c-43d7-8646-711a2e443f69 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.730777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324a654-ef8c-43d7-8646-711a2e443f69 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.731246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324a654-ef8c-43d7-8646-711a2e443f69 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.733425 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 181/345] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:25.734449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324a654-ef8c-43d7-8646-711a2e443f69 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:25.761310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 165/346] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 16:17:25.763011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d98712-30c8-46c7-9c99-af3c789e4728 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.763483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d98712-30c8-46c7-9c99-af3c789e4728 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.763914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d98712-30c8-46c7-9c99-af3c789e4728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.782151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a3d98712-30c8-46c7-9c99-af3c789e4728 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:25.783575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a3d98712-30c8-46c7-9c99-af3c789e4728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:25.850886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:25.859228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324a654-ef8c-43d7-8646-711a2e443f69 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:25.868413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 166/347] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:25.869973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885cba9-393e-4464-b804-702ce047e30a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.870859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885cba9-393e-4464-b804-702ce047e30a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.871286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885cba9-393e-4464-b804-702ce047e30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.893334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b885cba9-393e-4464-b804-702ce047e30a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:25.894772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b885cba9-393e-4464-b804-702ce047e30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:25.896926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545446d-30cd-4a10-9047-591729ca0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:25.898164 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545446d-30cd-4a10-9047-591729ca0ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:25.898639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545446d-30cd-4a10-9047-591729ca0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:25.899096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545446d-30cd-4a10-9047-591729ca0ae1 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:25.901791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545446d-30cd-4a10-9047-591729ca0ae1 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:25.904089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545446d-30cd-4a10-9047-591729ca0ae1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:25.906313 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 182/348] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:25 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:25.907701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545446d-30cd-4a10-9047-591729ca0ae1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:25.916830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:25.976452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 167/349] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:25.977832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885cba9-393e-4464-b804-702ce047e30a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.055921 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545446d-30cd-4a10-9047-591729ca0ae1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.095183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e69ce-a984-4b45-b83d-35c6377269a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.095399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885cba9-393e-4464-b804-702ce047e30a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.096405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e69ce-a984-4b45-b83d-35c6377269a4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.096970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e69ce-a984-4b45-b83d-35c6377269a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.097485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e69ce-a984-4b45-b83d-35c6377269a4 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.098873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e69ce-a984-4b45-b83d-35c6377269a4 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:26.100478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e69ce-a984-4b45-b83d-35c6377269a4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:26.106253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 183/350] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:25 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:26.107326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e69ce-a984-4b45-b83d-35c6377269a4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.133615 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76216d45-edd5-463a-83a3-5a58f9c8ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.134429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76216d45-edd5-463a-83a3-5a58f9c8ff08 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.134706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76216d45-edd5-463a-83a3-5a58f9c8ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.134977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76216d45-edd5-463a-83a3-5a58f9c8ff08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.144917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:26.149021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76216d45-edd5-463a-83a3-5a58f9c8ff08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-76216d45-edd5-463a-83a3-5a58f9c8ff08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:26.159178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:26.160107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:26.160941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 168/351] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:26.161596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76216d45-edd5-463a-83a3-5a58f9c8ff08 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.174193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:26.234747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e69ce-a984-4b45-b83d-35c6377269a4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.274393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335f37-7184-4795-a1ac-dc36ed542399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.275432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335f37-7184-4795-a1ac-dc36ed542399 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.275718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335f37-7184-4795-a1ac-dc36ed542399 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.275997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335f37-7184-4795-a1ac-dc36ed542399 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.283533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335f37-7184-4795-a1ac-dc36ed542399 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:26.285055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335f37-7184-4795-a1ac-dc36ed542399 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:26.286945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 184/352] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:26 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:26.288261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672014e-b12b-4a0d-9a31-bdef622d4b95 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.288549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672014e-b12b-4a0d-9a31-bdef622d4b95 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.288829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672014e-b12b-4a0d-9a31-bdef622d4b95 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.290094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 185/353] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:26.290848 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672014e-b12b-4a0d-9a31-bdef622d4b95 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.292157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76216d45-edd5-463a-83a3-5a58f9c8ff08 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.334335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58dac6-011d-4f9f-a766-4ee3eb6d8f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.335233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58dac6-011d-4f9f-a766-4ee3eb6d8f35 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.335524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58dac6-011d-4f9f-a766-4ee3eb6d8f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.335797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58dac6-011d-4f9f-a766-4ee3eb6d8f35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.353080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58dac6-011d-4f9f-a766-4ee3eb6d8f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ec58dac6-011d-4f9f-a766-4ee3eb6d8f35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:26.361281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:26.362208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:26.363282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 169/354] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:26.363973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58dac6-011d-4f9f-a766-4ee3eb6d8f35 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.413838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:26.426602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672014e-b12b-4a0d-9a31-bdef622d4b95 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.455597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:26.474424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248c43c-710d-421f-a94c-320003487736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.475345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c43c-710d-421f-a94c-320003487736 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.475566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c43c-710d-421f-a94c-320003487736 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.475838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248c43c-710d-421f-a94c-320003487736 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.477030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248c43c-710d-421f-a94c-320003487736 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:26.478464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248c43c-710d-421f-a94c-320003487736 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:26.480107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 186/355] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:26 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:26.481302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f906fbc-c74c-453d-a633-78f0ff95d20c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.481578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f906fbc-c74c-453d-a633-78f0ff95d20c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.481844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f906fbc-c74c-453d-a633-78f0ff95d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.501145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58dac6-011d-4f9f-a766-4ee3eb6d8f35 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.503406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4f906fbc-c74c-453d-a633-78f0ff95d20c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:26.504581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4f906fbc-c74c-453d-a633-78f0ff95d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:26.539563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e4b6a-46fc-4ef6-9715-be95189907bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.540249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e4b6a-46fc-4ef6-9715-be95189907bc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.540551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e4b6a-46fc-4ef6-9715-be95189907bc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.540812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e4b6a-46fc-4ef6-9715-be95189907bc None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.541610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e4b6a-46fc-4ef6-9715-be95189907bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:26.541920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e4b6a-46fc-4ef6-9715-be95189907bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:26.543324 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e4b6a-46fc-4ef6-9715-be95189907bc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:26.552885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 170/356] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:26.553354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e4b6a-46fc-4ef6-9715-be95189907bc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.596381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 187/357] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:26.597807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f906fbc-c74c-453d-a633-78f0ff95d20c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.672468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e4b6a-46fc-4ef6-9715-be95189907bc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.698905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:26.707094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f906fbc-c74c-453d-a633-78f0ff95d20c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.709935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:26.718195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b777b5-430a-492f-90d4-66bbcb3ce0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.718980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b777b5-430a-492f-90d4-66bbcb3ce0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.719891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b777b5-430a-492f-90d4-66bbcb3ce0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.720176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b777b5-430a-492f-90d4-66bbcb3ce0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.721097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b777b5-430a-492f-90d4-66bbcb3ce0b7 None admin] RBAC: Adding query filter params (group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:26.721409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b777b5-430a-492f-90d4-66bbcb3ce0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:26.722895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b777b5-430a-492f-90d4-66bbcb3ce0b7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:26.729169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 171/358] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:26 2022] GET /identity/v3/role_assignments?group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:26.730457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dc900-d6ce-4d09-9d25-1f39e0d40ed9 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.730742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dc900-d6ce-4d09-9d25-1f39e0d40ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.731018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168dc900-d6ce-4d09-9d25-1f39e0d40ed9 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.732297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 172/359] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:26.733676 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dc900-d6ce-4d09-9d25-1f39e0d40ed9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.762769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de95d18-0e47-40c6-8b42-99996b5e4351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.763595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de95d18-0e47-40c6-8b42-99996b5e4351 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.763951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de95d18-0e47-40c6-8b42-99996b5e4351 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.764293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de95d18-0e47-40c6-8b42-99996b5e4351 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.765258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de95d18-0e47-40c6-8b42-99996b5e4351 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:26.765664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de95d18-0e47-40c6-8b42-99996b5e4351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:26.767959 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de95d18-0e47-40c6-8b42-99996b5e4351 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:26.780934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 188/360] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:26.780934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de95d18-0e47-40c6-8b42-99996b5e4351 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.890090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168dc900-d6ce-4d09-9d25-1f39e0d40ed9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.924119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de95d18-0e47-40c6-8b42-99996b5e4351 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:26.931055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab0e7-7130-4b2b-b7e5-be69bd44b375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.931729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab0e7-7130-4b2b-b7e5-be69bd44b375 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.932011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab0e7-7130-4b2b-b7e5-be69bd44b375 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.932280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ab0e7-7130-4b2b-b7e5-be69bd44b375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:26.933770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ab0e7-7130-4b2b-b7e5-be69bd44b375 None admin] RBAC: Adding query filter params (group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:26.933770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ab0e7-7130-4b2b-b7e5-be69bd44b375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:26.935074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ab0e7-7130-4b2b-b7e5-be69bd44b375 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:26.942698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 173/361] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:26 2022] GET /identity/v3/role_assignments?group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:26.942698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab0e7-7130-4b2b-b7e5-be69bd44b375 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:26.984235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bf43-5211-46e6-a6de-38ec51f3b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:26.984995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bf43-5211-46e6-a6de-38ec51f3b623 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:26.985281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bf43-5211-46e6-a6de-38ec51f3b623 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:26.985842 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627bf43-5211-46e6-a6de-38ec51f3b623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:27.022784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:27.029270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:27.082198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ab0e7-7130-4b2b-b7e5-be69bd44b375 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:27.086978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bf43-5211-46e6-a6de-38ec51f3b623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:27.088695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627bf43-5211-46e6-a6de-38ec51f3b623 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:27.131068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98e739-348c-447a-a04c-afd979709c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:27.131068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e739-348c-447a-a04c-afd979709c63 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:27.131068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e739-348c-447a-a04c-afd979709c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:27.131423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98e739-348c-447a-a04c-afd979709c63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:27.147818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98e739-348c-447a-a04c-afd979709c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cd98e739-348c-447a-a04c-afd979709c63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:27.156788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:27.157742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:27.158530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:27.160500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 174/362] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:27.162028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac50db-d616-4e5b-b026-79c8ce089ebf None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:27.162457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac50db-d616-4e5b-b026-79c8ce089ebf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:27.162873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ac50db-d616-4e5b-b026-79c8ce089ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:27.182497 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-66ac50db-d616-4e5b-b026-79c8ce089ebf None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:27.183712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-66ac50db-d616-4e5b-b026-79c8ce089ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:27.238009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 189/363] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:27.241794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bf43-5211-46e6-a6de-38ec51f3b623 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:27.276797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 175/364] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:27.277770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac50db-d616-4e5b-b026-79c8ce089ebf None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:27.315727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:27.343069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:27.375554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627bf43-5211-46e6-a6de-38ec51f3b623 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:27.413781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ac50db-d616-4e5b-b026-79c8ce089ebf None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:27.432335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd800555-cdc2-46ce-8b46-f3cbd5480acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:27.433491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd800555-cdc2-46ce-8b46-f3cbd5480acc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:27.433778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd800555-cdc2-46ce-8b46-f3cbd5480acc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:27.434055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd800555-cdc2-46ce-8b46-f3cbd5480acc None admin] PATH_INFO: `/v3/users/47461d59f1cd4cc697faef59eb11364e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:27.435433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd800555-cdc2-46ce-8b46-f3cbd5480acc None admin] RBAC: Authorizing `identity:get_user(user_id=47461d59f1cd4cc697faef59eb11364e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:27.437325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd800555-cdc2-46ce-8b46-f3cbd5480acc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:27.439009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 190/365] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:17:27 2022] GET /identity/v3/users/47461d59f1cd4cc697faef59eb11364e => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:27.440433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd800555-cdc2-46ce-8b46-f3cbd5480acc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:27.457756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67033257-edef-469f-8757-95059ac1954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:27.458837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67033257-edef-469f-8757-95059ac1954d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:27.459350 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67033257-edef-469f-8757-95059ac1954d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:27.459840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67033257-edef-469f-8757-95059ac1954d None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:27.460976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67033257-edef-469f-8757-95059ac1954d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:27.461525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67033257-edef-469f-8757-95059ac1954d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:27.463191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67033257-edef-469f-8757-95059ac1954d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:27.473682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 176/366] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:27.474974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67033257-edef-469f-8757-95059ac1954d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:27.555291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd800555-cdc2-46ce-8b46-f3cbd5480acc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:27.580587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:27.591938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01783e9-20da-4d0b-9441-24e05c262249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:27.593220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01783e9-20da-4d0b-9441-24e05c262249 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:27.594013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01783e9-20da-4d0b-9441-24e05c262249 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:27.594718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01783e9-20da-4d0b-9441-24e05c262249 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:27.595020 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67033257-edef-469f-8757-95059ac1954d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:27.596356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01783e9-20da-4d0b-9441-24e05c262249 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:27.597974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01783e9-20da-4d0b-9441-24e05c262249 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:27.605237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 191/367] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:27 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:27.606193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01783e9-20da-4d0b-9441-24e05c262249 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:27.608435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:27.635578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2f5e4-01a4-4f18-badf-f9d20ded783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:27.636745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f5e4-01a4-4f18-badf-f9d20ded783a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:27.637406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f5e4-01a4-4f18-badf-f9d20ded783a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:27.637994 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f5e4-01a4-4f18-badf-f9d20ded783a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:27.649648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2f5e4-01a4-4f18-badf-f9d20ded783a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d2e2f5e4-01a4-4f18-badf-f9d20ded783a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:27.658303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:27.659214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:27.660026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:27.662898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 177/368] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:27.664015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2f5e4-01a4-4f18-badf-f9d20ded783a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:27.733613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01783e9-20da-4d0b-9441-24e05c262249 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:27.794811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce027ce7-18a7-4e98-83f0-46326e814091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:27.795483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027ce7-18a7-4e98-83f0-46326e814091 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:27.795759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027ce7-18a7-4e98-83f0-46326e814091 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:27.796053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce027ce7-18a7-4e98-83f0-46326e814091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:27.797302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce027ce7-18a7-4e98-83f0-46326e814091 None admin] RBAC: Adding query filter params (role.id=554f851c7f784bbc9dc162466570cb20, user.id=47461d59f1cd4cc697faef59eb11364e, scope.system=all) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:27.797609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce027ce7-18a7-4e98-83f0-46326e814091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:27.799127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce027ce7-18a7-4e98-83f0-46326e814091 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:27.814595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 192/369] 10.222.0.59 () {56 vars in 1308 bytes} [Fri Jul 1 16:17:27 2022] GET /identity/v3/role_assignments?user.id=47461d59f1cd4cc697faef59eb11364e&scope.system=all&role.id=554f851c7f784bbc9dc162466570cb20 => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:27.815199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce027ce7-18a7-4e98-83f0-46326e814091 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:27.822291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2f5e4-01a4-4f18-badf-f9d20ded783a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:27.869706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e823c3-8a01-4bb5-bb83-27182cca1e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:27.870785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e823c3-8a01-4bb5-bb83-27182cca1e50 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:27.871432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e823c3-8a01-4bb5-bb83-27182cca1e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:27.871906 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e823c3-8a01-4bb5-bb83-27182cca1e50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:27.876039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:27.925850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:27.954412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce027ce7-18a7-4e98-83f0-46326e814091 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:27.967421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e823c3-8a01-4bb5-bb83-27182cca1e50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:27.969956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e823c3-8a01-4bb5-bb83-27182cca1e50 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:28.002744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35707-e6a2-4187-8188-193be19f4aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:28.003637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35707-e6a2-4187-8188-193be19f4aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:28.003916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35707-e6a2-4187-8188-193be19f4aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:28.004190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35707-e6a2-4187-8188-193be19f4aa9 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:28.005620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35707-e6a2-4187-8188-193be19f4aa9 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:28.007079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35707-e6a2-4187-8188-193be19f4aa9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:28.008918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 193/370] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:27 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:28.013715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35707-e6a2-4187-8188-193be19f4aa9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:28.109361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 178/371] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:28.110508 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e823c3-8a01-4bb5-bb83-27182cca1e50 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:28.158108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35707-e6a2-4187-8188-193be19f4aa9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:28.179429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:28.200957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:28.203581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310bff-96a6-4919-bd8e-48e3a682e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:28.204465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310bff-96a6-4919-bd8e-48e3a682e096 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:28.204861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310bff-96a6-4919-bd8e-48e3a682e096 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:28.205237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310bff-96a6-4919-bd8e-48e3a682e096 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:28.206090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4310bff-96a6-4919-bd8e-48e3a682e096 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:28.206494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4310bff-96a6-4919-bd8e-48e3a682e096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:28.207976 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4310bff-96a6-4919-bd8e-48e3a682e096 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:28.219460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 194/372] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:28.224891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310bff-96a6-4919-bd8e-48e3a682e096 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:28.256032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e823c3-8a01-4bb5-bb83-27182cca1e50 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:28.293765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f5c9d-d321-4da0-ae2c-514e49116f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:28.294726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f5c9d-d321-4da0-ae2c-514e49116f6d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:28.295018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f5c9d-d321-4da0-ae2c-514e49116f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:28.295458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f5c9d-d321-4da0-ae2c-514e49116f6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:28.296809 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f5c9d-d321-4da0-ae2c-514e49116f6d None admin] RBAC: Adding query filter params (group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:28.297542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f5c9d-d321-4da0-ae2c-514e49116f6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:28.299548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f5c9d-d321-4da0-ae2c-514e49116f6d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:28.308359 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 179/373] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:28 2022] GET /identity/v3/role_assignments?group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:28.309364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f5c9d-d321-4da0-ae2c-514e49116f6d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:28.379030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310bff-96a6-4919-bd8e-48e3a682e096 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:28.445237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80224f-e52c-479e-9f91-2a8be8836223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:28.446529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80224f-e52c-479e-9f91-2a8be8836223 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:28.446981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80224f-e52c-479e-9f91-2a8be8836223 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:28.447420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80224f-e52c-479e-9f91-2a8be8836223 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:28.451358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80224f-e52c-479e-9f91-2a8be8836223 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:28.453610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80224f-e52c-479e-9f91-2a8be8836223 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:28.455935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 195/374] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:28 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:28.461419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80224f-e52c-479e-9f91-2a8be8836223 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:28.509226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f5c9d-d321-4da0-ae2c-514e49116f6d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:28.542041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:28.565207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6b89c-73f1-4131-9dc1-1a04185159a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:28.565885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6b89c-73f1-4131-9dc1-1a04185159a1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:28.566169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6b89c-73f1-4131-9dc1-1a04185159a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:28.566446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac6b89c-73f1-4131-9dc1-1a04185159a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:28.571059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:28.634355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80224f-e52c-479e-9f91-2a8be8836223 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:28.677446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854273-899b-4f0a-86d6-76427c81891b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:28.678318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854273-899b-4f0a-86d6-76427c81891b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:28.678597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854273-899b-4f0a-86d6-76427c81891b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:28.678872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854273-899b-4f0a-86d6-76427c81891b None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:28.681570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5854273-899b-4f0a-86d6-76427c81891b None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:28.683028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5854273-899b-4f0a-86d6-76427c81891b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:28.685080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 196/375] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:28 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:28.692833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854273-899b-4f0a-86d6-76427c81891b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:28.717668 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6b89c-73f1-4131-9dc1-1a04185159a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:28.719163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac6b89c-73f1-4131-9dc1-1a04185159a1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:28.900793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5854273-899b-4f0a-86d6-76427c81891b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:28.933686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:28.942514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 180/376] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:28.954271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6b89c-73f1-4131-9dc1-1a04185159a1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:28.978504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9f1c6-d2fe-45ec-b2dc-f7ca9d80273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:28.979092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9f1c6-d2fe-45ec-b2dc-f7ca9d80273a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:28.979385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9f1c6-d2fe-45ec-b2dc-f7ca9d80273a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:28.979642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9f1c6-d2fe-45ec-b2dc-f7ca9d80273a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:28.980478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9f1c6-d2fe-45ec-b2dc-f7ca9d80273a None admin] RBAC: Adding query filter params (group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:28.980787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9f1c6-d2fe-45ec-b2dc-f7ca9d80273a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:28.982265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9f1c6-d2fe-45ec-b2dc-f7ca9d80273a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:28.988888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 197/377] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:28 2022] GET /identity/v3/role_assignments?group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 260 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:28.997002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:29.073636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac6b89c-73f1-4131-9dc1-1a04185159a1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:29.116541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc6ba1-a9e0-4495-ae95-4b7c38c5fcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:29.117466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc6ba1-a9e0-4495-ae95-4b7c38c5fcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:29.117751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc6ba1-a9e0-4495-ae95-4b7c38c5fcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:29.118031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc6ba1-a9e0-4495-ae95-4b7c38c5fcd1 None admin] PATH_INFO: `/v3/projects/41f78c5209a64d8eb2f67286358f8191` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:29.119246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc6ba1-a9e0-4495-ae95-4b7c38c5fcd1 None admin] RBAC: Authorizing `identity:get_project(project_id=41f78c5209a64d8eb2f67286358f8191)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:29.120735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc6ba1-a9e0-4495-ae95-4b7c38c5fcd1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:29.122854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 181/378] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:28 2022] GET /identity/v3/projects/41f78c5209a64d8eb2f67286358f8191 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:29.128219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9f1c6-d2fe-45ec-b2dc-f7ca9d80273a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:29.164627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a2a18-e3f8-4a18-a585-cbe52d9fc10d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:29.164977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a2a18-e3f8-4a18-a585-cbe52d9fc10d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:29.165217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a2a18-e3f8-4a18-a585-cbe52d9fc10d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:29.166621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 182/379] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:29.172608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4d1f0-43ab-49ff-9669-c974116b2ce8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:29.172927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4d1f0-43ab-49ff-9669-c974116b2ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:29.173189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4d1f0-43ab-49ff-9669-c974116b2ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:29.197726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-44e4d1f0-43ab-49ff-9669-c974116b2ce8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:29.198938 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-44e4d1f0-43ab-49ff-9669-c974116b2ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:29.265163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9f1c6-d2fe-45ec-b2dc-f7ca9d80273a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:29.319174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195dec4-f927-44ab-85f4-f8102c6b1030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:29.320427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195dec4-f927-44ab-85f4-f8102c6b1030 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:29.321556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195dec4-f927-44ab-85f4-f8102c6b1030 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:29.322051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195dec4-f927-44ab-85f4-f8102c6b1030 None admin] PATH_INFO: `/v3/groups/e611a1b0796f4c68a1468eeec085a101` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:29.327755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195dec4-f927-44ab-85f4-f8102c6b1030 None admin] RBAC: Authorizing `identity:get_group(group_id=e611a1b0796f4c68a1468eeec085a101)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:29.329472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195dec4-f927-44ab-85f4-f8102c6b1030 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:29.332303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 198/380] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:29 2022] GET /identity/v3/groups/e611a1b0796f4c68a1468eeec085a101 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:29.337963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195dec4-f927-44ab-85f4-f8102c6b1030 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:29.354421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 183/381] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:29.392256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4d1f0-43ab-49ff-9669-c974116b2ce8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:29.417225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:29.466217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:29.478029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195dec4-f927-44ab-85f4-f8102c6b1030 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:29.541664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a79b52-1992-453c-aedd-555b4638a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:29.542267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a79b52-1992-453c-aedd-555b4638a727 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:29.542548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a79b52-1992-453c-aedd-555b4638a727 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:29.542819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a79b52-1992-453c-aedd-555b4638a727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:29.543666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a79b52-1992-453c-aedd-555b4638a727 None admin] RBAC: Adding query filter params (group.id=e611a1b0796f4c68a1468eeec085a101, role.id=842af9e8967047df873d061df391e820, scope.project.id=41f78c5209a64d8eb2f67286358f8191) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:29.543973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a79b52-1992-453c-aedd-555b4638a727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:29.545554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a79b52-1992-453c-aedd-555b4638a727 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:29.566961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 199/382] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:29 2022] GET /identity/v3/role_assignments?group.id=e611a1b0796f4c68a1468eeec085a101&scope.project.id=41f78c5209a64d8eb2f67286358f8191&role.id=842af9e8967047df873d061df391e820 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:29.571254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4d1f0-43ab-49ff-9669-c974116b2ce8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:29.612746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899778f-9a0b-4b1d-a762-f01be41feab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:29.613674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899778f-9a0b-4b1d-a762-f01be41feab4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:29.613956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899778f-9a0b-4b1d-a762-f01be41feab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:29.614227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899778f-9a0b-4b1d-a762-f01be41feab4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:29.626745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b899778f-9a0b-4b1d-a762-f01be41feab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b899778f-9a0b-4b1d-a762-f01be41feab4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:29.634825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:29.635774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:29.636541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 184/383] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:29.643871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a79b52-1992-453c-aedd-555b4638a727 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:29.644455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2efb70-b34b-459f-9bf0-3e8d73a7da01 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:29.644737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2efb70-b34b-459f-9bf0-3e8d73a7da01 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:29.645037 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2efb70-b34b-459f-9bf0-3e8d73a7da01 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:29.646692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 185/384] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:29.656933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c74d2-ea4b-4d22-8971-7dd4e91b7daa None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:29.657547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c74d2-ea4b-4d22-8971-7dd4e91b7daa None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:29.658013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c74d2-ea4b-4d22-8971-7dd4e91b7daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:29.694268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9c6c74d2-ea4b-4d22-8971-7dd4e91b7daa None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:29.695540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9c6c74d2-ea4b-4d22-8971-7dd4e91b7daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:29.801201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 186/385] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:29.823253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a79b52-1992-453c-aedd-555b4638a727 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:29.833338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:29.839620 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c74d2-ea4b-4d22-8971-7dd4e91b7daa None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:29.879901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:29.889396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f8620-00f6-455a-84e9-fd36d1c1f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:29.890614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f8620-00f6-455a-84e9-fd36d1c1f74c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:29.891041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f8620-00f6-455a-84e9-fd36d1c1f74c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:29.891699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f8620-00f6-455a-84e9-fd36d1c1f74c None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:29.893054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f8620-00f6-455a-84e9-fd36d1c1f74c None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:29.893512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f8620-00f6-455a-84e9-fd36d1c1f74c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:29.895213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f8620-00f6-455a-84e9-fd36d1c1f74c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:29.909095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 200/386] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:29.914776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f8620-00f6-455a-84e9-fd36d1c1f74c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:30.035670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c74d2-ea4b-4d22-8971-7dd4e91b7daa None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:30.098482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f8620-00f6-455a-84e9-fd36d1c1f74c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:30.109408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5654ada-1b23-4268-ad45-f558fb3a2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:30.110489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5654ada-1b23-4268-ad45-f558fb3a2e91 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:30.110914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5654ada-1b23-4268-ad45-f558fb3a2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:30.111365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5654ada-1b23-4268-ad45-f558fb3a2e91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:30.129885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5654ada-1b23-4268-ad45-f558fb3a2e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d5654ada-1b23-4268-ad45-f558fb3a2e91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:30.138639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:30.139773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:30.140792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:30.151514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 187/387] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:30.155333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5654ada-1b23-4268-ad45-f558fb3a2e91 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:30.173947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f836e5d-d89d-49de-978e-b888a7dfbed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:30.175068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f836e5d-d89d-49de-978e-b888a7dfbed3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:30.175491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f836e5d-d89d-49de-978e-b888a7dfbed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:30.175905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f836e5d-d89d-49de-978e-b888a7dfbed3 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:30.177296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f836e5d-d89d-49de-978e-b888a7dfbed3 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:30.180052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f836e5d-d89d-49de-978e-b888a7dfbed3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:30.182443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 201/388] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:29 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:30.188087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f836e5d-d89d-49de-978e-b888a7dfbed3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:30.265213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:30.337107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f836e5d-d89d-49de-978e-b888a7dfbed3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:30.360728 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:30.376642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6265d6a-02ec-49cb-829f-afeafaf4263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:30.378323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6265d6a-02ec-49cb-829f-afeafaf4263d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:30.378753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6265d6a-02ec-49cb-829f-afeafaf4263d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:30.379207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6265d6a-02ec-49cb-829f-afeafaf4263d None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:30.380613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6265d6a-02ec-49cb-829f-afeafaf4263d None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:30.382522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6265d6a-02ec-49cb-829f-afeafaf4263d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:30.385044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 202/389] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:30 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:30.398243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6265d6a-02ec-49cb-829f-afeafaf4263d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:30.430801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5654ada-1b23-4268-ad45-f558fb3a2e91 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:30.521357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6265d6a-02ec-49cb-829f-afeafaf4263d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:30.532550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c053f-86a0-40b2-8459-2f0a192895b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:30.533282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c053f-86a0-40b2-8459-2f0a192895b4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:30.533563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c053f-86a0-40b2-8459-2f0a192895b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:30.533840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c053f-86a0-40b2-8459-2f0a192895b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:30.534599 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c053f-86a0-40b2-8459-2f0a192895b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:30.534911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c053f-86a0-40b2-8459-2f0a192895b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:30.536332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c053f-86a0-40b2-8459-2f0a192895b4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:30.541195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:30.550531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 188/390] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:30.556903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c053f-86a0-40b2-8459-2f0a192895b4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:30.570809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea5dc2-7fbe-4e60-ae48-655bde7ed6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:30.571716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea5dc2-7fbe-4e60-ae48-655bde7ed6f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:30.572001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea5dc2-7fbe-4e60-ae48-655bde7ed6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:30.572278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea5dc2-7fbe-4e60-ae48-655bde7ed6f6 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:30.576675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea5dc2-7fbe-4e60-ae48-655bde7ed6f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7ff669ba2a843c0aa02b2322f0cca24, group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:30.578384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea5dc2-7fbe-4e60-ae48-655bde7ed6f6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:30.608064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 203/391] 10.222.0.59 () {58 vars in 1442 bytes} [Fri Jul 1 16:17:30 2022] PUT /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:30.718393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c053f-86a0-40b2-8459-2f0a192895b4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:30.779342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea849-6e43-497e-82fe-1c2816837f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:30.780229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea849-6e43-497e-82fe-1c2816837f3e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:30.780560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea849-6e43-497e-82fe-1c2816837f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:30.780830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea849-6e43-497e-82fe-1c2816837f3e None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:30.782140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ea849-6e43-497e-82fe-1c2816837f3e None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:30.783647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ea849-6e43-497e-82fe-1c2816837f3e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:30.785650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 189/392] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:30 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:30.791571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea5dc2-7fbe-4e60-ae48-655bde7ed6f6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:30.910812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9019-6e8c-4b39-a1eb-fdf0091d593c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:30.911324 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9019-6e8c-4b39-a1eb-fdf0091d593c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:30.911429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9019-6e8c-4b39-a1eb-fdf0091d593c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:30.912939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 190/393] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:30.913299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea5dc2-7fbe-4e60-ae48-655bde7ed6f6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:30.918419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935c39-d7b4-4c7e-8417-a4093c26211c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:30.918708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935c39-d7b4-4c7e-8417-a4093c26211c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:30.918980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72935c39-d7b4-4c7e-8417-a4093c26211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:30.949386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-72935c39-d7b4-4c7e-8417-a4093c26211c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:30.950560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-72935c39-d7b4-4c7e-8417-a4093c26211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:30.954868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb67a-1341-4c3d-821f-ed283362d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:30.956022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb67a-1341-4c3d-821f-ed283362d030 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:30.956500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb67a-1341-4c3d-821f-ed283362d030 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:30.957001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cb67a-1341-4c3d-821f-ed283362d030 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:30.959198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cb67a-1341-4c3d-821f-ed283362d030 None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:30.960869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86cb67a-1341-4c3d-821f-ed283362d030 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:30.963239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:30.963609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 204/394] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:30 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:30.971573 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb67a-1341-4c3d-821f-ed283362d030 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:31.040199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:31.090725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 191/395] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:31.128262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72935c39-d7b4-4c7e-8417-a4093c26211c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:31.162188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cb67a-1341-4c3d-821f-ed283362d030 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:31.230899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434cbf-6bcd-4ac9-b6df-04ab996994c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:31.231719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434cbf-6bcd-4ac9-b6df-04ab996994c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:31.232002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434cbf-6bcd-4ac9-b6df-04ab996994c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:31.232281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434cbf-6bcd-4ac9-b6df-04ab996994c7 None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee/roles/a97ad9c1458d4bf3a071884c10cae46c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:31.237522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3434cbf-6bcd-4ac9-b6df-04ab996994c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7ff669ba2a843c0aa02b2322f0cca24, group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role_id=a97ad9c1458d4bf3a071884c10cae46c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:31.239000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3434cbf-6bcd-4ac9-b6df-04ab996994c7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:31.273490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 205/396] 10.222.0.59 () {58 vars in 1442 bytes} [Fri Jul 1 16:17:30 2022] PUT /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee/roles/a97ad9c1458d4bf3a071884c10cae46c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:31.298799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72935c39-d7b4-4c7e-8417-a4093c26211c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:31.336117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05143a-5d4a-45df-907e-6323e528f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:31.336985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05143a-5d4a-45df-907e-6323e528f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:31.337271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05143a-5d4a-45df-907e-6323e528f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:31.337544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05143a-5d4a-45df-907e-6323e528f4a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:31.350153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05143a-5d4a-45df-907e-6323e528f4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6e05143a-5d4a-45df-907e-6323e528f4a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:31.358696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:31.359705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:31.360597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 192/397] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:31.367958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434cbf-6bcd-4ac9-b6df-04ab996994c7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:31.487863 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:31.494451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434cbf-6bcd-4ac9-b6df-04ab996994c7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:31.531829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69221a64-8d05-4ff9-b2c5-8cfe5ed6ed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:31.532511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69221a64-8d05-4ff9-b2c5-8cfe5ed6ed7e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:31.532794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69221a64-8d05-4ff9-b2c5-8cfe5ed6ed7e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:31.533100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69221a64-8d05-4ff9-b2c5-8cfe5ed6ed7e None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:31.533926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69221a64-8d05-4ff9-b2c5-8cfe5ed6ed7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:31.534295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69221a64-8d05-4ff9-b2c5-8cfe5ed6ed7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:31.535744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69221a64-8d05-4ff9-b2c5-8cfe5ed6ed7e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:31.544963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 206/398] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:31.551537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05143a-5d4a-45df-907e-6323e528f4a0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:31.555283 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:31.664349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05143a-5d4a-45df-907e-6323e528f4a0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:31.712262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc458b-ef44-44c8-8f56-fc09b6a790d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:31.713175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc458b-ef44-44c8-8f56-fc09b6a790d2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:31.713455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc458b-ef44-44c8-8f56-fc09b6a790d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:31.713728 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc458b-ef44-44c8-8f56-fc09b6a790d2 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:31.714915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc458b-ef44-44c8-8f56-fc09b6a790d2 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:31.716370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc458b-ef44-44c8-8f56-fc09b6a790d2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:31.718082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 193/399] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:31 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:31.723829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69221a64-8d05-4ff9-b2c5-8cfe5ed6ed7e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:31.788184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e4265-52ae-456f-a06a-601b9556862d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:31.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e4265-52ae-456f-a06a-601b9556862d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:31.789239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e4265-52ae-456f-a06a-601b9556862d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:31.790890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 194/400] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:31.796967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f4c0-e2a5-4995-af2b-b071090bc1a9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:31.797332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f4c0-e2a5-4995-af2b-b071090bc1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:31.797530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f4c0-e2a5-4995-af2b-b071090bc1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:31.829222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4327f4c0-e2a5-4995-af2b-b071090bc1a9 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:31.830439 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4327f4c0-e2a5-4995-af2b-b071090bc1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:31.879346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69221a64-8d05-4ff9-b2c5-8cfe5ed6ed7e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:31.908041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:31.915957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 195/401] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:31.917548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eed2f3-939b-4416-a1fb-89c60d67599c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:31.917835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eed2f3-939b-4416-a1fb-89c60d67599c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:31.918007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b4c9d-5e9c-46a1-9fac-dcde863e8340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:31.918142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eed2f3-939b-4416-a1fb-89c60d67599c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:31.919069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b4c9d-5e9c-46a1-9fac-dcde863e8340 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:31.919439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b4c9d-5e9c-46a1-9fac-dcde863e8340 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:31.919638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 196/402] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:31.923920 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b4c9d-5e9c-46a1-9fac-dcde863e8340 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:31.926117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f6c94-f2b2-45aa-bc9d-726c920bf99e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:31.926954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b4c9d-5e9c-46a1-9fac-dcde863e8340 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:31.928511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b4c9d-5e9c-46a1-9fac-dcde863e8340 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:31.928911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f6c94-f2b2-45aa-bc9d-726c920bf99e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:31.929288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f6c94-f2b2-45aa-bc9d-726c920bf99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:31.933508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 207/403] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:31 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:31.937370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b4c9d-5e9c-46a1-9fac-dcde863e8340 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:31.949705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1e8f6c94-f2b2-45aa-bc9d-726c920bf99e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:31.951087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1e8f6c94-f2b2-45aa-bc9d-726c920bf99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:31.966274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:32.039512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 197/404] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:32.041157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f6c94-f2b2-45aa-bc9d-726c920bf99e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:32.053439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b4c9d-5e9c-46a1-9fac-dcde863e8340 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:32.097645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258560-10cb-44fc-a5c0-82ad179c3e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:32.098482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258560-10cb-44fc-a5c0-82ad179c3e0f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:32.098758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258560-10cb-44fc-a5c0-82ad179c3e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:32.099028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d258560-10cb-44fc-a5c0-82ad179c3e0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:32.111579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d258560-10cb-44fc-a5c0-82ad179c3e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5d258560-10cb-44fc-a5c0-82ad179c3e0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:32.119699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:32.120660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:32.121475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 208/405] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:32.122142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258560-10cb-44fc-a5c0-82ad179c3e0f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:32.177552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f6c94-f2b2-45aa-bc9d-726c920bf99e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:32.207548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:32.213892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaee6df-da68-4123-9604-0f2ded1114ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:32.214986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaee6df-da68-4123-9604-0f2ded1114ae None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:32.215739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaee6df-da68-4123-9604-0f2ded1114ae None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:32.216440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaee6df-da68-4123-9604-0f2ded1114ae None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:32.218898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaee6df-da68-4123-9604-0f2ded1114ae None admin] RBAC: Authorizing `identity:create_grant(project_id=698dfbe68a2342439db4f2b52c2b34a6, group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:32.221055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaee6df-da68-4123-9604-0f2ded1114ae None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:32.223390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:32.241387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 198/406] 10.222.0.59 () {58 vars in 1442 bytes} [Fri Jul 1 16:17:32 2022] PUT /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:32.242735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaee6df-da68-4123-9604-0f2ded1114ae None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:32.249030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d258560-10cb-44fc-a5c0-82ad179c3e0f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:32.296742 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790db7dd-10dc-4193-aa69-51b67d47b024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:32.297596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790db7dd-10dc-4193-aa69-51b67d47b024 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:32.297983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790db7dd-10dc-4193-aa69-51b67d47b024 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:32.298315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790db7dd-10dc-4193-aa69-51b67d47b024 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:32.318784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790db7dd-10dc-4193-aa69-51b67d47b024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-790db7dd-10dc-4193-aa69-51b67d47b024 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:32.335386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:32.336400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:32.341458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 209/407] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:17:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:32.353220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790db7dd-10dc-4193-aa69-51b67d47b024 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:32.372373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaee6df-da68-4123-9604-0f2ded1114ae None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:32.414204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e28635-4b29-4dc1-9206-54e5f240019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:32.415191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28635-4b29-4dc1-9206-54e5f240019e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:32.415629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28635-4b29-4dc1-9206-54e5f240019e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:32.416054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e28635-4b29-4dc1-9206-54e5f240019e None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:32.417010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e28635-4b29-4dc1-9206-54e5f240019e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:32.417456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e28635-4b29-4dc1-9206-54e5f240019e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:32.419039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e28635-4b29-4dc1-9206-54e5f240019e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:32.436820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 199/408] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:32.448054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e28635-4b29-4dc1-9206-54e5f240019e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:32.507319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:32.513524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790db7dd-10dc-4193-aa69-51b67d47b024 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:32.549930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a8fa-403a-475e-af16-b1bebcf8dbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:32.550632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a8fa-403a-475e-af16-b1bebcf8dbcf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:32.550996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a8fa-403a-475e-af16-b1bebcf8dbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:32.551431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a8fa-403a-475e-af16-b1bebcf8dbcf None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:32.552289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a8fa-403a-475e-af16-b1bebcf8dbcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:32.552699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a8fa-403a-475e-af16-b1bebcf8dbcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:32.554178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a8fa-403a-475e-af16-b1bebcf8dbcf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:32.563839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 210/409] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:32.564177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e28635-4b29-4dc1-9206-54e5f240019e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:32.569643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a8fa-403a-475e-af16-b1bebcf8dbcf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:32.580910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:32.604417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de10b4-9e1b-469c-bab3-877056954d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:32.605872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de10b4-9e1b-469c-bab3-877056954d38 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:32.606346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de10b4-9e1b-469c-bab3-877056954d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:32.606788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de10b4-9e1b-469c-bab3-877056954d38 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:32.608616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de10b4-9e1b-469c-bab3-877056954d38 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:32.610432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de10b4-9e1b-469c-bab3-877056954d38 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:32.612596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 200/410] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:32 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:32.628633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de10b4-9e1b-469c-bab3-877056954d38 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:32.714389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a8fa-403a-475e-af16-b1bebcf8dbcf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:32.796510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213026dc-2d16-4207-b552-7efd3ee3898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:32.797408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213026dc-2d16-4207-b552-7efd3ee3898a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:32.797687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213026dc-2d16-4207-b552-7efd3ee3898a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:32.797963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213026dc-2d16-4207-b552-7efd3ee3898a None admin] PATH_INFO: `/v3/groups/e611a1b0796f4c68a1468eeec085a101` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:32.799350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213026dc-2d16-4207-b552-7efd3ee3898a None admin] RBAC: Authorizing `identity:get_group(group_id=e611a1b0796f4c68a1468eeec085a101)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:32.800886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213026dc-2d16-4207-b552-7efd3ee3898a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:32.807878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 211/411] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:32 2022] GET /identity/v3/groups/e611a1b0796f4c68a1468eeec085a101 => generated 229 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:32.808702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213026dc-2d16-4207-b552-7efd3ee3898a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:32.851027 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de10b4-9e1b-469c-bab3-877056954d38 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:32.895703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:32.902328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:32.927438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad75d1-a1df-4360-a977-62e2ad2f0abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:32.928324 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad75d1-a1df-4360-a977-62e2ad2f0abd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:32.928607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad75d1-a1df-4360-a977-62e2ad2f0abd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:32.928908 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad75d1-a1df-4360-a977-62e2ad2f0abd None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:32.930227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad75d1-a1df-4360-a977-62e2ad2f0abd None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:32.931694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad75d1-a1df-4360-a977-62e2ad2f0abd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:32.933455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 201/412] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:32 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:32.939511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad75d1-a1df-4360-a977-62e2ad2f0abd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:32.944483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213026dc-2d16-4207-b552-7efd3ee3898a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:33.007712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabc0e6-e9b2-4bd9-b4e2-bddda1f4b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:33.008593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabc0e6-e9b2-4bd9-b4e2-bddda1f4b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.008949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabc0e6-e9b2-4bd9-b4e2-bddda1f4b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.009229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabc0e6-e9b2-4bd9-b4e2-bddda1f4b6b9 None admin] PATH_INFO: `/v3/projects/41f78c5209a64d8eb2f67286358f8191` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:33.010464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabc0e6-e9b2-4bd9-b4e2-bddda1f4b6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=41f78c5209a64d8eb2f67286358f8191)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:33.012891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabc0e6-e9b2-4bd9-b4e2-bddda1f4b6b9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:33.013711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 212/413] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:32 2022] GET /identity/v3/projects/41f78c5209a64d8eb2f67286358f8191 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:33.019640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabc0e6-e9b2-4bd9-b4e2-bddda1f4b6b9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:33.122987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad75d1-a1df-4360-a977-62e2ad2f0abd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:33.170088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10759a9-3f66-44d4-a5e7-05183cfefd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:33.171189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10759a9-3f66-44d4-a5e7-05183cfefd48 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.171467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10759a9-3f66-44d4-a5e7-05183cfefd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.171739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10759a9-3f66-44d4-a5e7-05183cfefd48 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee/roles/a97ad9c1458d4bf3a071884c10cae46c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:33.174200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10759a9-3f66-44d4-a5e7-05183cfefd48 None admin] RBAC: Authorizing `identity:create_grant(project_id=698dfbe68a2342439db4f2b52c2b34a6, group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role_id=a97ad9c1458d4bf3a071884c10cae46c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:33.175680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10759a9-3f66-44d4-a5e7-05183cfefd48 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:33.176256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabc0e6-e9b2-4bd9-b4e2-bddda1f4b6b9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:33.201280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 202/414] 10.222.0.59 () {58 vars in 1442 bytes} [Fri Jul 1 16:17:32 2022] PUT /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee/roles/a97ad9c1458d4bf3a071884c10cae46c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:33.203072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277ea80-1671-44e8-a5d5-f4bab7f27547 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.203360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277ea80-1671-44e8-a5d5-f4bab7f27547 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.203635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277ea80-1671-44e8-a5d5-f4bab7f27547 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:33.205570 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 203/415] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:33.212285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a8ce5-a452-4add-b755-95850688a1dd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.212607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a8ce5-a452-4add-b755-95850688a1dd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.212981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a8ce5-a452-4add-b755-95850688a1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:33.218145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73324db7-a73f-4373-9998-03641a5015e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:33.219375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324db7-a73f-4373-9998-03641a5015e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.219880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324db7-a73f-4373-9998-03641a5015e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.220419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73324db7-a73f-4373-9998-03641a5015e4 None admin] PATH_INFO: `/v3/projects/41f78c5209a64d8eb2f67286358f8191/groups/e611a1b0796f4c68a1468eeec085a101/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:33.222896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73324db7-a73f-4373-9998-03641a5015e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=41f78c5209a64d8eb2f67286358f8191, group_id=e611a1b0796f4c68a1468eeec085a101, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:33.224622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73324db7-a73f-4373-9998-03641a5015e4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:33.249108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 213/416] 10.222.0.59 () {58 vars in 1442 bytes} [Fri Jul 1 16:17:33 2022] PUT /identity/v3/projects/41f78c5209a64d8eb2f67286358f8191/groups/e611a1b0796f4c68a1468eeec085a101/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:17:33.250413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e73a8ce5-a452-4add-b755-95850688a1dd None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:33.251705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e73a8ce5-a452-4add-b755-95850688a1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:33.325329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:33.353005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 204/417] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:33.399169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73324db7-a73f-4373-9998-03641a5015e4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:33.402653 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:33.513852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73324db7-a73f-4373-9998-03641a5015e4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:33.548801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1feded1-b4ab-4d27-829d-6adc6833b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:33.550009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feded1-b4ab-4d27-829d-6adc6833b687 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.550493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feded1-b4ab-4d27-829d-6adc6833b687 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.550990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1feded1-b4ab-4d27-829d-6adc6833b687 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:33.565747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1feded1-b4ab-4d27-829d-6adc6833b687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f1feded1-b4ab-4d27-829d-6adc6833b687 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:33.574295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:33.575281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:33.576086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:33.583396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 214/418] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:33.585967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a8ce5-a452-4add-b755-95850688a1dd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:33.705660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a8ce5-a452-4add-b755-95850688a1dd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:33.757030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724a11c-f2ad-4839-ac2f-b458e4c40cd6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.757333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724a11c-f2ad-4839-ac2f-b458e4c40cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.757585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724a11c-f2ad-4839-ac2f-b458e4c40cd6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:33.759279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 215/419] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:33.764278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf89f5c-7740-4c98-9c68-9e2119439a9a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.764711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf89f5c-7740-4c98-9c68-9e2119439a9a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.764945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf89f5c-7740-4c98-9c68-9e2119439a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:33.766694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae159d2-2d4d-4bc5-9c13-01dfcdcf4c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:33.767487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae159d2-2d4d-4bc5-9c13-01dfcdcf4c07 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.767777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae159d2-2d4d-4bc5-9c13-01dfcdcf4c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.768055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae159d2-2d4d-4bc5-9c13-01dfcdcf4c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:33.768922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae159d2-2d4d-4bc5-9c13-01dfcdcf4c07 None admin] RBAC: Adding query filter params (name=member) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:33.769280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae159d2-2d4d-4bc5-9c13-01dfcdcf4c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:33.770697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae159d2-2d4d-4bc5-9c13-01dfcdcf4c07 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:33.784559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 205/420] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:33.785842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae159d2-2d4d-4bc5-9c13-01dfcdcf4c07 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:33.802582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2cf89f5c-7740-4c98-9c68-9e2119439a9a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:33.803796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2cf89f5c-7740-4c98-9c68-9e2119439a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:33.841209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:33.916507 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:33.935639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 216/421] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:33.938796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae159d2-2d4d-4bc5-9c13-01dfcdcf4c07 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:33.968615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf89f5c-7740-4c98-9c68-9e2119439a9a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:33.987409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e859106-e080-4753-913d-3e440d973dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:33.988076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e859106-e080-4753-913d-3e440d973dbd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:33.988355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e859106-e080-4753-913d-3e440d973dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:33.988627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e859106-e080-4753-913d-3e440d973dbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:34.112603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e859106-e080-4753-913d-3e440d973dbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:34.114135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e859106-e080-4753-913d-3e440d973dbd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:34.136038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf89f5c-7740-4c98-9c68-9e2119439a9a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:34.187512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:34.197951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff73ae-7ef3-4c04-bb72-2d9d0bb95e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:34.198774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff73ae-7ef3-4c04-bb72-2d9d0bb95e61 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:34.199055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff73ae-7ef3-4c04-bb72-2d9d0bb95e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:34.199331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff73ae-7ef3-4c04-bb72-2d9d0bb95e61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:34.219426 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff73ae-7ef3-4c04-bb72-2d9d0bb95e61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-23ff73ae-7ef3-4c04-bb72-2d9d0bb95e61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:34.232196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:34.233493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:34.234269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:34.235331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 217/422] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:34.240291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff73ae-7ef3-4c04-bb72-2d9d0bb95e61 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:34.304057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 206/423] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:34.313585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e859106-e080-4753-913d-3e440d973dbd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:34.333259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:34.386981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff73ae-7ef3-4c04-bb72-2d9d0bb95e61 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:34.452412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cf2da-e9fd-4e0f-9ed9-4a0f9a236772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:34.453139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cf2da-e9fd-4e0f-9ed9-4a0f9a236772 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:34.453423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cf2da-e9fd-4e0f-9ed9-4a0f9a236772 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:34.453700 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cf2da-e9fd-4e0f-9ed9-4a0f9a236772 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:34.454454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cf2da-e9fd-4e0f-9ed9-4a0f9a236772 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:34.454756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cf2da-e9fd-4e0f-9ed9-4a0f9a236772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:34.456149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5cf2da-e9fd-4e0f-9ed9-4a0f9a236772 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:34.465153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e859106-e080-4753-913d-3e440d973dbd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:34.471283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 218/424] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:34.476597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cf2da-e9fd-4e0f-9ed9-4a0f9a236772 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:34.501895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474258f-5a44-44dd-8e22-36e4ef7d32fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:34.502824 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474258f-5a44-44dd-8e22-36e4ef7d32fc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:34.503110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474258f-5a44-44dd-8e22-36e4ef7d32fc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:34.503386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474258f-5a44-44dd-8e22-36e4ef7d32fc None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:34.504581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474258f-5a44-44dd-8e22-36e4ef7d32fc None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:34.506071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474258f-5a44-44dd-8e22-36e4ef7d32fc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:34.512357 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 207/425] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:34 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:34.513834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474258f-5a44-44dd-8e22-36e4ef7d32fc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:34.533192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:34.626628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474258f-5a44-44dd-8e22-36e4ef7d32fc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:34.637894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5cf2da-e9fd-4e0f-9ed9-4a0f9a236772 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:34.653225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:34.675770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8e77e-f855-4f77-9094-eef5092c7240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:34.676429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e77e-f855-4f77-9094-eef5092c7240 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:34.676708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e77e-f855-4f77-9094-eef5092c7240 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:34.677020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8e77e-f855-4f77-9094-eef5092c7240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:34.694354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8b3c-8e18-48d3-a0e9-924805e9f6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:34.695244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8b3c-8e18-48d3-a0e9-924805e9f6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:34.695526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8b3c-8e18-48d3-a0e9-924805e9f6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:34.695800 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f8b3c-8e18-48d3-a0e9-924805e9f6c4 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:34.698730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f8b3c-8e18-48d3-a0e9-924805e9f6c4 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:34.700219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f8b3c-8e18-48d3-a0e9-924805e9f6c4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:34.702118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 208/426] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:34 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:34.708374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8b3c-8e18-48d3-a0e9-924805e9f6c4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:34.810184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e77e-f855-4f77-9094-eef5092c7240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:34.811855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8e77e-f855-4f77-9094-eef5092c7240 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:34.834988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:34.865090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f8b3c-8e18-48d3-a0e9-924805e9f6c4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:34.913094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341f1ea-7bf9-4c2a-8a43-90302dd7e57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:34.913764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f1ea-7bf9-4c2a-8a43-90302dd7e57a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:34.914043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f1ea-7bf9-4c2a-8a43-90302dd7e57a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:34.914345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f1ea-7bf9-4c2a-8a43-90302dd7e57a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:34.915346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341f1ea-7bf9-4c2a-8a43-90302dd7e57a None admin] RBAC: Adding query filter params (group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:34.915663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341f1ea-7bf9-4c2a-8a43-90302dd7e57a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:34.917166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341f1ea-7bf9-4c2a-8a43-90302dd7e57a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:34.924149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 209/427] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:34 2022] GET /identity/v3/role_assignments?group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:34.925455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab5504-dd5b-4633-971d-7ad8b7923ddc None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:34.925740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab5504-dd5b-4633-971d-7ad8b7923ddc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:34.925892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 219/428] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:34.926335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab5504-dd5b-4633-971d-7ad8b7923ddc None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:34.927403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 210/429] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:34.932706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab5504-dd5b-4633-971d-7ad8b7923ddc None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:34.933273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa152486-79f4-4468-914a-9e809e86de28 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:34.933653 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa152486-79f4-4468-914a-9e809e86de28 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:34.934024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa152486-79f4-4468-914a-9e809e86de28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:34.956312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-aa152486-79f4-4468-914a-9e809e86de28 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:34.958510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-aa152486-79f4-4468-914a-9e809e86de28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:34.972930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:35.050147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 220/430] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:35.084085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa152486-79f4-4468-914a-9e809e86de28 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:35.085932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab5504-dd5b-4633-971d-7ad8b7923ddc None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:35.149605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865d47d-b276-48ff-ac39-44edc258419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:35.150637 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865d47d-b276-48ff-ac39-44edc258419b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.151947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865d47d-b276-48ff-ac39-44edc258419b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.152456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865d47d-b276-48ff-ac39-44edc258419b None admin] PATH_INFO: `/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.153918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865d47d-b276-48ff-ac39-44edc258419b None admin] RBAC: Authorizing `identity:get_project(project_id=b7ff669ba2a843c0aa02b2322f0cca24)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:35.155694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865d47d-b276-48ff-ac39-44edc258419b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:35.158277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 211/431] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:34 2022] GET /identity/v3/projects/b7ff669ba2a843c0aa02b2322f0cca24 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:35.163666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865d47d-b276-48ff-ac39-44edc258419b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:35.196373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:35.255865 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa152486-79f4-4468-914a-9e809e86de28 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:35.294236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dbf0f-1dda-4fc0-aa5d-b31e5255df69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:35.295326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dbf0f-1dda-4fc0-aa5d-b31e5255df69 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.295824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dbf0f-1dda-4fc0-aa5d-b31e5255df69 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.296236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dbf0f-1dda-4fc0-aa5d-b31e5255df69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.297232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865d47d-b276-48ff-ac39-44edc258419b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:35.310176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dbf0f-1dda-4fc0-aa5d-b31e5255df69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-278dbf0f-1dda-4fc0-aa5d-b31e5255df69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:35.318308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:35.319335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 01 16:17:35.320147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:35.323892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 221/432] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:35.333027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dbf0f-1dda-4fc0-aa5d-b31e5255df69 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:35.337029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:35.342196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30e50d-58f3-45b6-ab6e-03adc7ffbaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:35.343425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30e50d-58f3-45b6-ab6e-03adc7ffbaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.343907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30e50d-58f3-45b6-ab6e-03adc7ffbaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.344377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30e50d-58f3-45b6-ab6e-03adc7ffbaf1 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.346996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30e50d-58f3-45b6-ab6e-03adc7ffbaf1 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:35.349071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30e50d-58f3-45b6-ab6e-03adc7ffbaf1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:35.351993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 212/433] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:35 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:35.358514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30e50d-58f3-45b6-ab6e-03adc7ffbaf1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:35.468589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:35.475269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dbf0f-1dda-4fc0-aa5d-b31e5255df69 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:35.495368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30e50d-58f3-45b6-ab6e-03adc7ffbaf1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:35.515919 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06213b-68f7-49a0-a2cb-c6c652d9abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:35.516657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06213b-68f7-49a0-a2cb-c6c652d9abf2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.516970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06213b-68f7-49a0-a2cb-c6c652d9abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.517246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06213b-68f7-49a0-a2cb-c6c652d9abf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.518156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06213b-68f7-49a0-a2cb-c6c652d9abf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:35.518465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06213b-68f7-49a0-a2cb-c6c652d9abf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:35.520068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06213b-68f7-49a0-a2cb-c6c652d9abf2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:35.529799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 222/434] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:17:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:35.535469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06213b-68f7-49a0-a2cb-c6c652d9abf2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:35.537417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5dffa-584c-45d7-aa11-5210b75a5e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:35.538338 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5dffa-584c-45d7-aa11-5210b75a5e53 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.538815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5dffa-584c-45d7-aa11-5210b75a5e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.539282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5dffa-584c-45d7-aa11-5210b75a5e53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.540315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5dffa-584c-45d7-aa11-5210b75a5e53 None admin] RBAC: Adding query filter params (group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:35.540887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5dffa-584c-45d7-aa11-5210b75a5e53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:35.542545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5dffa-584c-45d7-aa11-5210b75a5e53 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:35.549154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 213/435] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:35 2022] GET /identity/v3/role_assignments?group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee&scope.project.id=b7ff669ba2a843c0aa02b2322f0cca24&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:35.600969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491adf40-cd9e-4de8-adc6-212598c59e9c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.601290 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491adf40-cd9e-4de8-adc6-212598c59e9c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.601534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491adf40-cd9e-4de8-adc6-212598c59e9c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.603174 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 214/436] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:35.609162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f03b52-c232-4f51-b586-8025d93523c7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.609481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f03b52-c232-4f51-b586-8025d93523c7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.609721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f03b52-c232-4f51-b586-8025d93523c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.629746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e1f03b52-c232-4f51-b586-8025d93523c7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:35.630577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:35.632175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e1f03b52-c232-4f51-b586-8025d93523c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:35.668502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06213b-68f7-49a0-a2cb-c6c652d9abf2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:35.707678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf97910-01d8-4fa3-a681-58419e0603e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:35.708433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf97910-01d8-4fa3-a681-58419e0603e9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.708783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf97910-01d8-4fa3-a681-58419e0603e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.709158 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf97910-01d8-4fa3-a681-58419e0603e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.716441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 215/437] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:35.742649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f03b52-c232-4f51-b586-8025d93523c7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:35.789325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf97910-01d8-4fa3-a681-58419e0603e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:35.790832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf97910-01d8-4fa3-a681-58419e0603e9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:35.836046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:35.870874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:35.882226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f03b52-c232-4f51-b586-8025d93523c7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:35.926192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 223/438] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 01 16:17:35.926856 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a23554-dba4-4df7-925c-ed7126d6ec42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:35.927328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23554-dba4-4df7-925c-ed7126d6ec42 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.927607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23554-dba4-4df7-925c-ed7126d6ec42 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.927875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a23554-dba4-4df7-925c-ed7126d6ec42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.927961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41417bbf-2069-426e-8c5e-c789ad22b3f8 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.928256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41417bbf-2069-426e-8c5e-c789ad22b3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.928599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41417bbf-2069-426e-8c5e-c789ad22b3f8 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.930120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 224/439] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:35.934800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41417bbf-2069-426e-8c5e-c789ad22b3f8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:35.941514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a23554-dba4-4df7-925c-ed7126d6ec42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-25a23554-dba4-4df7-925c-ed7126d6ec42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:35.950123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:35.951084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:35.952294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 216/440] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:17:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:35.953335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640f94-0e7c-4e7b-9aec-8c6bb356ea6e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:35.955418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640f94-0e7c-4e7b-9aec-8c6bb356ea6e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:35.955418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18640f94-0e7c-4e7b-9aec-8c6bb356ea6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:35.972438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-18640f94-0e7c-4e7b-9aec-8c6bb356ea6e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:35.973659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-18640f94-0e7c-4e7b-9aec-8c6bb356ea6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:36.056023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 217/441] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:36.056915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640f94-0e7c-4e7b-9aec-8c6bb356ea6e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.064051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41417bbf-2069-426e-8c5e-c789ad22b3f8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.098004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9bc76-7d9c-4ea9-8cad-95f7395b4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.098866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9bc76-7d9c-4ea9-8cad-95f7395b4d45 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.099142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9bc76-7d9c-4ea9-8cad-95f7395b4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.099411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9bc76-7d9c-4ea9-8cad-95f7395b4d45 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.100572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9bc76-7d9c-4ea9-8cad-95f7395b4d45 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:36.102036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9bc76-7d9c-4ea9-8cad-95f7395b4d45 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:36.103713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 225/442] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:35 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:36.104462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9bc76-7d9c-4ea9-8cad-95f7395b4d45 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.123231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:36.140117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:36.167077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18640f94-0e7c-4e7b-9aec-8c6bb356ea6e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.200602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25ceb0-61c2-4bfe-b240-6b01368f34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.201469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25ceb0-61c2-4bfe-b240-6b01368f34ce None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.201751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25ceb0-61c2-4bfe-b240-6b01368f34ce None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.202023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25ceb0-61c2-4bfe-b240-6b01368f34ce None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.202607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9bc76-7d9c-4ea9-8cad-95f7395b4d45 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.202790 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25ceb0-61c2-4bfe-b240-6b01368f34ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:36.203090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25ceb0-61c2-4bfe-b240-6b01368f34ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:36.204482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25ceb0-61c2-4bfe-b240-6b01368f34ce None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:36.212628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 218/443] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:36.213244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25ceb0-61c2-4bfe-b240-6b01368f34ce None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.237489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126c8f1-f0e1-4623-94e1-7d2b75695da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.238289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126c8f1-f0e1-4623-94e1-7d2b75695da8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.238570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126c8f1-f0e1-4623-94e1-7d2b75695da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.238829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126c8f1-f0e1-4623-94e1-7d2b75695da8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.249091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126c8f1-f0e1-4623-94e1-7d2b75695da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8126c8f1-f0e1-4623-94e1-7d2b75695da8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:36.257094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:36.257983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:36.259120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 226/444] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:36.259946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126c8f1-f0e1-4623-94e1-7d2b75695da8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.321605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25ceb0-61c2-4bfe-b240-6b01368f34ce None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.344079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:36.355932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:36.356442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948f250-97af-43d0-b07c-b8c960ae1344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.357731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948f250-97af-43d0-b07c-b8c960ae1344 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.358127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948f250-97af-43d0-b07c-b8c960ae1344 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.358603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8948f250-97af-43d0-b07c-b8c960ae1344 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.359811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948f250-97af-43d0-b07c-b8c960ae1344 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:36.361325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8948f250-97af-43d0-b07c-b8c960ae1344 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:36.362947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 219/445] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:36.363447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126c8f1-f0e1-4623-94e1-7d2b75695da8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.363764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948f250-97af-43d0-b07c-b8c960ae1344 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.399201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995740f4-15ac-4c0a-8fa8-8325b269f276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.399774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995740f4-15ac-4c0a-8fa8-8325b269f276 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.400054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995740f4-15ac-4c0a-8fa8-8325b269f276 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.400324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995740f4-15ac-4c0a-8fa8-8325b269f276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.459486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8948f250-97af-43d0-b07c-b8c960ae1344 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.464512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995740f4-15ac-4c0a-8fa8-8325b269f276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:36.466098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995740f4-15ac-4c0a-8fa8-8325b269f276 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:36.494172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c61c6c-5a2f-437f-9e54-2618fb9d3861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.494973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c61c6c-5a2f-437f-9e54-2618fb9d3861 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.495256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c61c6c-5a2f-437f-9e54-2618fb9d3861 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.495528 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c61c6c-5a2f-437f-9e54-2618fb9d3861 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.496342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c61c6c-5a2f-437f-9e54-2618fb9d3861 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:36.496653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c61c6c-5a2f-437f-9e54-2618fb9d3861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:36.498068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c61c6c-5a2f-437f-9e54-2618fb9d3861 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:36.506217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 220/446] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:36.507016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c61c6c-5a2f-437f-9e54-2618fb9d3861 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.557346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:36.558877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:36.566479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 227/447] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:36.567479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995740f4-15ac-4c0a-8fa8-8325b269f276 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.611210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c61c6c-5a2f-437f-9e54-2618fb9d3861 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.644476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f1ddb-b595-49ff-a288-a59c90dde9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.645169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1ddb-b595-49ff-a288-a59c90dde9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.645451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1ddb-b595-49ff-a288-a59c90dde9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.645731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1ddb-b595-49ff-a288-a59c90dde9f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.646573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f1ddb-b595-49ff-a288-a59c90dde9f7 None admin] RBAC: Adding query filter params (group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role.id=bd597f50c9ba47888ac496a996ba3b71, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:36.646869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f1ddb-b595-49ff-a288-a59c90dde9f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:36.648395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f1ddb-b595-49ff-a288-a59c90dde9f7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:36.654157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 221/448] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/role_assignments?group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=bd597f50c9ba47888ac496a996ba3b71 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:36.654858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f1ddb-b595-49ff-a288-a59c90dde9f7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.666893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995740f4-15ac-4c0a-8fa8-8325b269f276 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.705518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5914028-c576-4648-801c-30ab825723d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.706195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914028-c576-4648-801c-30ab825723d6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.706477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914028-c576-4648-801c-30ab825723d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.706753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5914028-c576-4648-801c-30ab825723d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.771242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f1ddb-b595-49ff-a288-a59c90dde9f7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.783772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:36.790001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:36.793963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5914028-c576-4648-801c-30ab825723d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:36.796407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5914028-c576-4648-801c-30ab825723d6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:36.812524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b0ecf-a28e-4b56-8971-ddc4e12ca913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.813508 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b0ecf-a28e-4b56-8971-ddc4e12ca913 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.813803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b0ecf-a28e-4b56-8971-ddc4e12ca913 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.814050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b0ecf-a28e-4b56-8971-ddc4e12ca913 None admin] PATH_INFO: `/v3/projects/41f78c5209a64d8eb2f67286358f8191` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.815230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b0ecf-a28e-4b56-8971-ddc4e12ca913 None admin] RBAC: Authorizing `identity:get_project(project_id=41f78c5209a64d8eb2f67286358f8191)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:36.816690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b0ecf-a28e-4b56-8971-ddc4e12ca913 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:36.818431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 222/449] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/projects/41f78c5209a64d8eb2f67286358f8191 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:36.824111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b0ecf-a28e-4b56-8971-ddc4e12ca913 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.913440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 228/450] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:36.919089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5914028-c576-4648-801c-30ab825723d6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:36.943477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b0ecf-a28e-4b56-8971-ddc4e12ca913 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:36.979600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2ff33-ca55-4035-ac86-a3ce0ce81510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:36.980472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ff33-ca55-4035-ac86-a3ce0ce81510 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:36.980754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ff33-ca55-4035-ac86-a3ce0ce81510 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:36.981063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2ff33-ca55-4035-ac86-a3ce0ce81510 None admin] PATH_INFO: `/v3/groups/e611a1b0796f4c68a1468eeec085a101` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:36.982261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2ff33-ca55-4035-ac86-a3ce0ce81510 None admin] RBAC: Authorizing `identity:get_group(group_id=e611a1b0796f4c68a1468eeec085a101)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:36.984102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2ff33-ca55-4035-ac86-a3ce0ce81510 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:36.986840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 223/451] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/groups/e611a1b0796f4c68a1468eeec085a101 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:36.993639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2ff33-ca55-4035-ac86-a3ce0ce81510 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:37.027583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:37.034780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5914028-c576-4648-801c-30ab825723d6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:37.053888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:37.067589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c2b46-39f9-4fac-a51e-7cbceaa73d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:37.068452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2b46-39f9-4fac-a51e-7cbceaa73d76 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:37.068730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2b46-39f9-4fac-a51e-7cbceaa73d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:37.069035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2b46-39f9-4fac-a51e-7cbceaa73d76 None admin] PATH_INFO: `/v3/projects/698dfbe68a2342439db4f2b52c2b34a6` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:37.070193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c2b46-39f9-4fac-a51e-7cbceaa73d76 None admin] RBAC: Authorizing `identity:get_project(project_id=698dfbe68a2342439db4f2b52c2b34a6)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:37.071631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c2b46-39f9-4fac-a51e-7cbceaa73d76 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:37.073356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 229/452] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/projects/698dfbe68a2342439db4f2b52c2b34a6 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:37.078784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c2b46-39f9-4fac-a51e-7cbceaa73d76 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:37.102974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2ff33-ca55-4035-ac86-a3ce0ce81510 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:37.138180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c31002-5486-4f60-a1f3-c9643029dc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:37.138828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c31002-5486-4f60-a1f3-c9643029dc56 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:37.139113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c31002-5486-4f60-a1f3-c9643029dc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:37.139437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c31002-5486-4f60-a1f3-c9643029dc56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:37.140276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c31002-5486-4f60-a1f3-c9643029dc56 None admin] RBAC: Adding query filter params (group.id=e611a1b0796f4c68a1468eeec085a101, role.id=842af9e8967047df873d061df391e820, scope.project.id=41f78c5209a64d8eb2f67286358f8191) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:37.140588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c31002-5486-4f60-a1f3-c9643029dc56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:37.142070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c31002-5486-4f60-a1f3-c9643029dc56 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:37.147843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 224/453] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:36 2022] GET /identity/v3/role_assignments?group.id=e611a1b0796f4c68a1468eeec085a101&scope.project.id=41f78c5209a64d8eb2f67286358f8191&role.id=842af9e8967047df873d061df391e820 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:37.179300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c2b46-39f9-4fac-a51e-7cbceaa73d76 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:37.217783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6fc99-cac2-4617-8cc5-c18d601fa199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:37.218655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6fc99-cac2-4617-8cc5-c18d601fa199 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:37.218933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6fc99-cac2-4617-8cc5-c18d601fa199 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:37.219205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6fc99-cac2-4617-8cc5-c18d601fa199 None admin] PATH_INFO: `/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:37.220468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6fc99-cac2-4617-8cc5-c18d601fa199 None admin] RBAC: Authorizing `identity:get_group(group_id=3980eaf23c1d4f9d9ac5d64fb36a13ee)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:37.221960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6fc99-cac2-4617-8cc5-c18d601fa199 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:37.223638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 230/454] 10.222.0.59 () {56 vars in 1180 bytes} [Fri Jul 1 16:17:37 2022] GET /identity/v3/groups/3980eaf23c1d4f9d9ac5d64fb36a13ee => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:37.229891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c31002-5486-4f60-a1f3-c9643029dc56 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:37.338784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c31002-5486-4f60-a1f3-c9643029dc56 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:37.355081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:37.374074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e1590-a9b4-4955-849e-e8496ff27005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:37.374739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e1590-a9b4-4955-849e-e8496ff27005 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:37.375050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e1590-a9b4-4955-849e-e8496ff27005 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:37.375328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e1590-a9b4-4955-849e-e8496ff27005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:37.376168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e1590-a9b4-4955-849e-e8496ff27005 None admin] RBAC: Adding query filter params (group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee, role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=698dfbe68a2342439db4f2b52c2b34a6) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:37.376491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e1590-a9b4-4955-849e-e8496ff27005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:37.377994 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145e1590-a9b4-4955-849e-e8496ff27005 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:37.383950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 225/455] 10.222.0.59 () {56 vars in 1376 bytes} [Fri Jul 1 16:17:37 2022] GET /identity/v3/role_assignments?group.id=3980eaf23c1d4f9d9ac5d64fb36a13ee&scope.project.id=698dfbe68a2342439db4f2b52c2b34a6&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:40.084998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765df8be-b7cf-48b2-8bf0-aa14de13a635 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.084998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765df8be-b7cf-48b2-8bf0-aa14de13a635 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.084998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765df8be-b7cf-48b2-8bf0-aa14de13a635 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.085901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 231/456] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:40.090544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9caf-fbbe-4170-b68d-8082b849d678 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.091005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9caf-fbbe-4170-b68d-8082b849d678 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.091094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab9caf-fbbe-4170-b68d-8082b849d678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.123376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c5ab9caf-fbbe-4170-b68d-8082b849d678 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:40.124649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c5ab9caf-fbbe-4170-b68d-8082b849d678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:40.198820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d438-9dac-453a-b3d1-075d29544bdb None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.199105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d438-9dac-453a-b3d1-075d29544bdb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.199561 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0d438-9dac-453a-b3d1-075d29544bdb None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.201249 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 232/457] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:40.213522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff847d2-7c0b-4fd4-b4b2-5fabbc9934e8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.214080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff847d2-7c0b-4fd4-b4b2-5fabbc9934e8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.214576 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff847d2-7c0b-4fd4-b4b2-5fabbc9934e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.233677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 226/458] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:40.244661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fff847d2-7c0b-4fd4-b4b2-5fabbc9934e8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:40.246102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fff847d2-7c0b-4fd4-b4b2-5fabbc9934e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:40.258211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9caf-fbbe-4170-b68d-8082b849d678 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:40.298960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:40.388464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab9caf-fbbe-4170-b68d-8082b849d678 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:40.391701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 233/459] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:40.399972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:40.419797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaabaa1-e133-47e3-895d-7873857cef4e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.420097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaabaa1-e133-47e3-895d-7873857cef4e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.420358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaabaa1-e133-47e3-895d-7873857cef4e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.422171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 234/460] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:40.423103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaabaa1-e133-47e3-895d-7873857cef4e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:40.432879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efb4ea-5b1c-4e6d-9e5a-9701ddd6ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:40.432879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efb4ea-5b1c-4e6d-9e5a-9701ddd6ed7f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.432879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efb4ea-5b1c-4e6d-9e5a-9701ddd6ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.432879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efb4ea-5b1c-4e6d-9e5a-9701ddd6ed7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.444627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efb4ea-5b1c-4e6d-9e5a-9701ddd6ed7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:40.446314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efb4ea-5b1c-4e6d-9e5a-9701ddd6ed7f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-06efb4ea-5b1c-4e6d-9e5a-9701ddd6ed7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:40.466187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:40.467120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:40.468074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:40.468074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:40.468074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:40.468074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:40.468074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 227/461] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:40.469905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1023e-5ff2-4ede-a1e2-fd5883c90965 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.469905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1023e-5ff2-4ede-a1e2-fd5883c90965 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.469905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1023e-5ff2-4ede-a1e2-fd5883c90965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.494151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dbf1023e-5ff2-4ede-a1e2-fd5883c90965 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:40.495962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dbf1023e-5ff2-4ede-a1e2-fd5883c90965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:40.540386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaabaa1-e133-47e3-895d-7873857cef4e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:40.583145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 228/462] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:40.584087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2790ee-aeda-42ca-bec2-cd2753dbd6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:40.585160 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2790ee-aeda-42ca-bec2-cd2753dbd6bf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.585650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2790ee-aeda-42ca-bec2-cd2753dbd6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.586112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2790ee-aeda-42ca-bec2-cd2753dbd6bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.587769 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1023e-5ff2-4ede-a1e2-fd5883c90965 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:40.608185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2790ee-aeda-42ca-bec2-cd2753dbd6bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:40.610085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2790ee-aeda-42ca-bec2-cd2753dbd6bf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8b2790ee-aeda-42ca-bec2-cd2753dbd6bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:40.637804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:40.638771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:40.639713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:40.639713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:40.639713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:40.639713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:40.644552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 235/463] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:40.645537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2790ee-aeda-42ca-bec2-cd2753dbd6bf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:40.665193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:40.702091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:40.712390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1023e-5ff2-4ede-a1e2-fd5883c90965 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:40.757105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27967b27-e78b-4a15-89f1-a0b81022edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:40.758138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27967b27-e78b-4a15-89f1-a0b81022edc6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.758631 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27967b27-e78b-4a15-89f1-a0b81022edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.759110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27967b27-e78b-4a15-89f1-a0b81022edc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.760168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27967b27-e78b-4a15-89f1-a0b81022edc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:40.760683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27967b27-e78b-4a15-89f1-a0b81022edc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:40.762510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27967b27-e78b-4a15-89f1-a0b81022edc6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:40.776884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2790ee-aeda-42ca-bec2-cd2753dbd6bf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:40.782929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 229/464] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:40.784088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27967b27-e78b-4a15-89f1-a0b81022edc6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:40.817973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53931200-082e-4c8f-9ed6-52c66e72a599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:40.818787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53931200-082e-4c8f-9ed6-52c66e72a599 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.819070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53931200-082e-4c8f-9ed6-52c66e72a599 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.819346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53931200-082e-4c8f-9ed6-52c66e72a599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.834203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53931200-082e-4c8f-9ed6-52c66e72a599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:40.836561 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53931200-082e-4c8f-9ed6-52c66e72a599 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-53931200-082e-4c8f-9ed6-52c66e72a599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:40.859811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:40.860711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:40.861632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:40.861632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:40.861632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:40.861632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:40.862315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 236/465] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:40.863809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53931200-082e-4c8f-9ed6-52c66e72a599 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:40.910339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27967b27-e78b-4a15-89f1-a0b81022edc6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:40.932344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:40.948195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3f962-b78e-4802-90cf-d428b546e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:40.948871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3f962-b78e-4802-90cf-d428b546e67c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.949180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3f962-b78e-4802-90cf-d428b546e67c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.949484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3f962-b78e-4802-90cf-d428b546e67c None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.950215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3f962-b78e-4802-90cf-d428b546e67c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:40.950571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3f962-b78e-4802-90cf-d428b546e67c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:40.952001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3f962-b78e-4802-90cf-d428b546e67c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:40.964886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 230/466] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:40.965626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac67510-25f6-4259-99df-e84073b2ba4f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:40.965916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac67510-25f6-4259-99df-e84073b2ba4f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:40.966176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac67510-25f6-4259-99df-e84073b2ba4f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:40.967668 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 231/467] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:40.972232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac67510-25f6-4259-99df-e84073b2ba4f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:40.982784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53931200-082e-4c8f-9ed6-52c66e72a599 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:40.987592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:41.019562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429507af-6aff-4302-95a9-b1d086f3ee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:41.020338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429507af-6aff-4302-95a9-b1d086f3ee91 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.020617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429507af-6aff-4302-95a9-b1d086f3ee91 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.020919 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429507af-6aff-4302-95a9-b1d086f3ee91 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.021630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429507af-6aff-4302-95a9-b1d086f3ee91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:41.023084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429507af-6aff-4302-95a9-b1d086f3ee91 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:41.056882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 237/468] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:40 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:41.056882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429507af-6aff-4302-95a9-b1d086f3ee91 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:41.094187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac67510-25f6-4259-99df-e84073b2ba4f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:41.140661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cffc6-7df9-492b-9b1a-d106ada980f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:41.141736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cffc6-7df9-492b-9b1a-d106ada980f5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.142862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cffc6-7df9-492b-9b1a-d106ada980f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.143523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cffc6-7df9-492b-9b1a-d106ada980f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.145483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cffc6-7df9-492b-9b1a-d106ada980f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:41.146532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cffc6-7df9-492b-9b1a-d106ada980f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:41.149334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cffc6-7df9-492b-9b1a-d106ada980f5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:41.164591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429507af-6aff-4302-95a9-b1d086f3ee91 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:41.169262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 232/469] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:41.171176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc0532-81f1-4797-94c7-e18653349285 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.171672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc0532-81f1-4797-94c7-e18653349285 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.172146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc0532-81f1-4797-94c7-e18653349285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.194839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:41.199212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-05bc0532-81f1-4797-94c7-e18653349285 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:41.201183 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-05bc0532-81f1-4797-94c7-e18653349285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:41.214913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118ebc2-c474-4dff-9e78-6398be9aa83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:41.216030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118ebc2-c474-4dff-9e78-6398be9aa83c None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.216508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118ebc2-c474-4dff-9e78-6398be9aa83c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.217043 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118ebc2-c474-4dff-9e78-6398be9aa83c None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.217998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118ebc2-c474-4dff-9e78-6398be9aa83c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:41.219741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118ebc2-c474-4dff-9e78-6398be9aa83c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:41.243849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 238/470] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:41 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:41.244515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118ebc2-c474-4dff-9e78-6398be9aa83c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:41.292542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 233/471] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:41.318170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc0532-81f1-4797-94c7-e18653349285 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:41.320722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:41.379884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118ebc2-c474-4dff-9e78-6398be9aa83c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:41.433447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8812c5-f124-4442-8b22-ffbe7278e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:41.434460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8812c5-f124-4442-8b22-ffbe7278e0ac None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.434883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8812c5-f124-4442-8b22-ffbe7278e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.435339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8812c5-f124-4442-8b22-ffbe7278e0ac None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.437664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8812c5-f124-4442-8b22-ffbe7278e0ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:41.439279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8812c5-f124-4442-8b22-ffbe7278e0ac None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:41.450169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc0532-81f1-4797-94c7-e18653349285 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:41.471770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 239/472] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:41 2022] POST /identity/v3/users => generated 248 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:41.473831 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb125745-8faa-40fb-9110-7080540013ac None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.473831 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb125745-8faa-40fb-9110-7080540013ac None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.474019 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb125745-8faa-40fb-9110-7080540013ac None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.475576 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 240/473] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:41.481593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33203e-4742-4fbf-949a-14cdfeb70439 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.481896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33203e-4742-4fbf-949a-14cdfeb70439 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.482154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33203e-4742-4fbf-949a-14cdfeb70439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.497985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc69dd-0424-4b14-afb5-5803f62e67b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:41.498935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc69dd-0424-4b14-afb5-5803f62e67b3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.499237 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc69dd-0424-4b14-afb5-5803f62e67b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.499507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc69dd-0424-4b14-afb5-5803f62e67b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.503088 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2f33203e-4742-4fbf-949a-14cdfeb70439 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:41.504893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2f33203e-4742-4fbf-949a-14cdfeb70439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:41.516078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc69dd-0424-4b14-afb5-5803f62e67b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:41.518041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc69dd-0424-4b14-afb5-5803f62e67b3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a5fc69dd-0424-4b14-afb5-5803f62e67b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:41.544871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:41.545919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:41.546825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:41.546825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:41.546825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:41.546825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:41.547043 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:41.550168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 234/474] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:41.557132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc69dd-0424-4b14-afb5-5803f62e67b3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:41.603262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 241/475] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:41.629211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33203e-4742-4fbf-949a-14cdfeb70439 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:41.629613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:41.689038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc69dd-0424-4b14-afb5-5803f62e67b3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:41.727349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9dba1-ba4e-4574-9e92-93e4041915bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:41.728515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9dba1-ba4e-4574-9e92-93e4041915bc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.729027 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9dba1-ba4e-4574-9e92-93e4041915bc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.729500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9dba1-ba4e-4574-9e92-93e4041915bc None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.730428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9dba1-ba4e-4574-9e92-93e4041915bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:41.730993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9dba1-ba4e-4574-9e92-93e4041915bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:41.732729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9dba1-ba4e-4574-9e92-93e4041915bc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:41.745399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 235/476] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:41.751444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9dba1-ba4e-4574-9e92-93e4041915bc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:41.751896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33203e-4742-4fbf-949a-14cdfeb70439 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:41.786928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:41.787603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.787883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.788154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.788929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:41.790332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:41.798009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.sql.core [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 16:17:41.798009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 01 16:17:41.798009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [parameters: {'id': '8ef5a53aa9bb459fa5d41a7af452ac81', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 01 16:17:41.798009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80130) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jul 01 16:17:41.816351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return ref.to_dict() Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 16:17:41.817347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application yield resource Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise self.value Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application session.commit() Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 16:17:41.818244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.flush() Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application compat.raise_( Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 16:17:41.819109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 16:17:41.819999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 16:17:41.820803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [parameters: {'id': '8ef5a53aa9bb459fa5d41a7af452ac81', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:41.821667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 01 16:17:41.822571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:41.823418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 242/477] 10.222.0.59 () {60 vars in 1131 bytes} [Fri Jul 1 16:17:41 2022] POST /identity/v3/roles => generated 144 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:41.828240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:41.860590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9dba1-ba4e-4574-9e92-93e4041915bc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:41.865522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:41.877114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:41.900411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e370807-4bf6-4ac5-a0a6-22e763df674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:41.901400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e370807-4bf6-4ac5-a0a6-22e763df674e None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.901690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e370807-4bf6-4ac5-a0a6-22e763df674e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.902068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e370807-4bf6-4ac5-a0a6-22e763df674e None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:41.902958 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e370807-4bf6-4ac5-a0a6-22e763df674e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:41.904534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e370807-4bf6-4ac5-a0a6-22e763df674e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:41.942097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 236/478] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:41 2022] POST /identity/v3/users => generated 249 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:17:41.951286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2716d401-94d4-4dc8-8c6c-b2a959702a44 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:41.991698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953edb7c-6ae8-424f-b7c1-35517ffb4594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:41.992535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953edb7c-6ae8-424f-b7c1-35517ffb4594 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:41.992816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953edb7c-6ae8-424f-b7c1-35517ffb4594 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:41.993128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953edb7c-6ae8-424f-b7c1-35517ffb4594 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:42.006412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953edb7c-6ae8-424f-b7c1-35517ffb4594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-953edb7c-6ae8-424f-b7c1-35517ffb4594 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:42.015036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:42.016014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:42.017567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 243/479] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:17:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:42.022428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e370807-4bf6-4ac5-a0a6-22e763df674e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:42.158399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e370807-4bf6-4ac5-a0a6-22e763df674e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:42.195724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce204f-3794-4912-b3fa-acf8c568a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:42.196323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce204f-3794-4912-b3fa-acf8c568a945 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:42.196601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce204f-3794-4912-b3fa-acf8c568a945 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:42.196904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce204f-3794-4912-b3fa-acf8c568a945 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:42.197665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce204f-3794-4912-b3fa-acf8c568a945 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:42.197969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce204f-3794-4912-b3fa-acf8c568a945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:42.199361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce204f-3794-4912-b3fa-acf8c568a945 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:42.208419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 237/480] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:43.733877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6d14-db89-4931-aa89-9c972f51d6c8 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:43.734404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6d14-db89-4931-aa89-9c972f51d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:43.734404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf6d14-db89-4931-aa89-9c972f51d6c8 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:43.736091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 244/481] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:43.741315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4facd01-0308-46a8-a925-5c08ce308f10 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:43.741748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4facd01-0308-46a8-a925-5c08ce308f10 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:43.741923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4facd01-0308-46a8-a925-5c08ce308f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:43.766242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f4facd01-0308-46a8-a925-5c08ce308f10 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:43.767471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f4facd01-0308-46a8-a925-5c08ce308f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:43.809541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:43.865703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 238/482] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:43.900918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf6d14-db89-4931-aa89-9c972f51d6c8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:44.005336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:44.024894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf6d14-db89-4931-aa89-9c972f51d6c8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:44.064418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c19d-ccb7-4eb4-8696-569098280938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:44.065311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c19d-ccb7-4eb4-8696-569098280938 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.065596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c19d-ccb7-4eb4-8696-569098280938 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.065874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03c19d-ccb7-4eb4-8696-569098280938 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.078866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9e1f2-ad79-4180-b9a7-c85e38e7aff2 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.079204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9e1f2-ad79-4180-b9a7-c85e38e7aff2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.079426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9e1f2-ad79-4180-b9a7-c85e38e7aff2 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.080973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 239/483] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:44.086340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e4c3-df0b-4a71-a5f0-282ccd67b1ee None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.086693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03c19d-ccb7-4eb4-8696-569098280938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:44.087102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e4c3-df0b-4a71-a5f0-282ccd67b1ee None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.087590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e4c3-df0b-4a71-a5f0-282ccd67b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-0d03c19d-ccb7-4eb4-8696-569098280938 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:44.110783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:44.111953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:44.112782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 245/484] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:44.114513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c19d-ccb7-4eb4-8696-569098280938 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:44.123651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9806e4c3-df0b-4a71-a5f0-282ccd67b1ee None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:44.125890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9806e4c3-df0b-4a71-a5f0-282ccd67b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:44.213100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 240/485] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:44.214878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7bde6-2a37-488c-90a7-4cd8d6aeb947 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.215265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7bde6-2a37-488c-90a7-4cd8d6aeb947 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.215636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7bde6-2a37-488c-90a7-4cd8d6aeb947 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.221176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 241/486] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:44.230754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9389f-8806-464e-895c-1ff13ce0732e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.231157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9389f-8806-464e-895c-1ff13ce0732e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.231536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9389f-8806-464e-895c-1ff13ce0732e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.248622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03c19d-ccb7-4eb4-8696-569098280938 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:44.258376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c1f9389f-8806-464e-895c-1ff13ce0732e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:44.259831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c1f9389f-8806-464e-895c-1ff13ce0732e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:44.293525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10848284-01c0-4bc8-9a89-98098d1e47bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:44.294490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10848284-01c0-4bc8-9a89-98098d1e47bf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.294915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10848284-01c0-4bc8-9a89-98098d1e47bf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.295359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10848284-01c0-4bc8-9a89-98098d1e47bf None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.296514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10848284-01c0-4bc8-9a89-98098d1e47bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:44.296990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10848284-01c0-4bc8-9a89-98098d1e47bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:44.299445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10848284-01c0-4bc8-9a89-98098d1e47bf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:44.310535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 246/487] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:44.315156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10848284-01c0-4bc8-9a89-98098d1e47bf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:44.329940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:44.346117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 242/488] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:44.347314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9389f-8806-464e-895c-1ff13ce0732e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:44.390000 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:44.443231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10848284-01c0-4bc8-9a89-98098d1e47bf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:44.482672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8265eb6-8a4b-45f3-93d8-0e6d0fe9778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:44.483337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9389f-8806-464e-895c-1ff13ce0732e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:44.483650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265eb6-8a4b-45f3-93d8-0e6d0fe9778e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.484295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265eb6-8a4b-45f3-93d8-0e6d0fe9778e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.484721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8265eb6-8a4b-45f3-93d8-0e6d0fe9778e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.498248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8265eb6-8a4b-45f3-93d8-0e6d0fe9778e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f8265eb6-8a4b-45f3-93d8-0e6d0fe9778e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:44.506860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:44.507859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:44.508683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:44.513382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 247/489] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:44.515868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8265eb6-8a4b-45f3-93d8-0e6d0fe9778e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:44.534353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf943f0-694d-4f3d-a875-215c9b8a3d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:44.536222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf943f0-694d-4f3d-a875-215c9b8a3d3a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.536686 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf943f0-694d-4f3d-a875-215c9b8a3d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.537470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf943f0-694d-4f3d-a875-215c9b8a3d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.552224 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf943f0-694d-4f3d-a875-215c9b8a3d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:44.554574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf943f0-694d-4f3d-a875-215c9b8a3d3a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cdf943f0-694d-4f3d-a875-215c9b8a3d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:44.583674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:44.584601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:44.585463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:44.585463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:44.585463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:44.585463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:44.586242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 243/490] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:44.591456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf943f0-694d-4f3d-a875-215c9b8a3d3a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:44.596680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:44.638544 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8265eb6-8a4b-45f3-93d8-0e6d0fe9778e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:44.672498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e1482-3dd5-4c1b-b933-b01b90190f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:44.673332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e1482-3dd5-4c1b-b933-b01b90190f7d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.673617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e1482-3dd5-4c1b-b933-b01b90190f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.673894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e1482-3dd5-4c1b-b933-b01b90190f7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.677601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:44.684609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e1482-3dd5-4c1b-b933-b01b90190f7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-614e1482-3dd5-4c1b-b933-b01b90190f7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:44.692259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:44.693348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:44.694169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 248/491] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:44.694834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e1482-3dd5-4c1b-b933-b01b90190f7d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:44.705637 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf943f0-694d-4f3d-a875-215c9b8a3d3a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:44.745077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7004e-600b-436e-b0c3-58d4a3910ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:44.745755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7004e-600b-436e-b0c3-58d4a3910ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.746038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7004e-600b-436e-b0c3-58d4a3910ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.746312 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7004e-600b-436e-b0c3-58d4a3910ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.747063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7004e-600b-436e-b0c3-58d4a3910ea0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:44.747370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7004e-600b-436e-b0c3-58d4a3910ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:44.748899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7004e-600b-436e-b0c3-58d4a3910ea0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:44.757530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 244/492] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:44.758943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fb60f-fe18-4589-8897-7c9bda5cc6a7 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.759188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fb60f-fe18-4589-8897-7c9bda5cc6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.759433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fb60f-fe18-4589-8897-7c9bda5cc6a7 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.760653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 245/493] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:44.762083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5678e4-b6f8-4e73-8d0d-73b87855464c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.762213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5678e4-b6f8-4e73-8d0d-73b87855464c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.762448 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5678e4-b6f8-4e73-8d0d-73b87855464c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.763704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 246/494] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:44.764704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5678e4-b6f8-4e73-8d0d-73b87855464c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:44.803205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e1482-3dd5-4c1b-b933-b01b90190f7d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:44.829708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:44.837833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14067e-f493-4acb-a89d-81cd9e3c0fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:44.838502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14067e-f493-4acb-a89d-81cd9e3c0fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.838789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14067e-f493-4acb-a89d-81cd9e3c0fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.839064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14067e-f493-4acb-a89d-81cd9e3c0fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.839802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14067e-f493-4acb-a89d-81cd9e3c0fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:44.840103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14067e-f493-4acb-a89d-81cd9e3c0fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:44.841528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14067e-f493-4acb-a89d-81cd9e3c0fa9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:44.853403 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 249/495] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:44.854207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14067e-f493-4acb-a89d-81cd9e3c0fa9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:44.873670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5678e4-b6f8-4e73-8d0d-73b87855464c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:44.907034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6215b-c17e-40dc-b2c7-1e2798787b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:44.907948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6215b-c17e-40dc-b2c7-1e2798787b4e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.908230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6215b-c17e-40dc-b2c7-1e2798787b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.908502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6215b-c17e-40dc-b2c7-1e2798787b4e None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.909312 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6215b-c17e-40dc-b2c7-1e2798787b4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:44.909620 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6215b-c17e-40dc-b2c7-1e2798787b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:44.911013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6215b-c17e-40dc-b2c7-1e2798787b4e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:44.913193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:44.924514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 247/496] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:44.925909 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdcee0-aacb-4587-a26f-9c43c6a63af4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.926190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdcee0-aacb-4587-a26f-9c43c6a63af4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.926464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdcee0-aacb-4587-a26f-9c43c6a63af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.942499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-38fdcee0-aacb-4587-a26f-9c43c6a63af4 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:44.943675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-38fdcee0-aacb-4587-a26f-9c43c6a63af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:44.953013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14067e-f493-4acb-a89d-81cd9e3c0fa9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:44.986695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6fc24-3e74-4a40-90bd-94eb6c9df984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:44.987479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6fc24-3e74-4a40-90bd-94eb6c9df984 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:44.987756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6fc24-3e74-4a40-90bd-94eb6c9df984 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:44.988029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6fc24-3e74-4a40-90bd-94eb6c9df984 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:44.997821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6fc24-3e74-4a40-90bd-94eb6c9df984 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:44.999329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6fc24-3e74-4a40-90bd-94eb6c9df984 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.009015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 248/497] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:45.010216 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec356fb7-33fc-4cb7-98a8-05a4414771ad None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.010504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec356fb7-33fc-4cb7-98a8-05a4414771ad None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.010781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec356fb7-33fc-4cb7-98a8-05a4414771ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-2ac6fc24-3e74-4a40-90bd-94eb6c9df984 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:45.016379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:45.017463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:45.022898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:45.022898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:45.022898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:45.022898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:45.022898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 250/498] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:45.022898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6fc24-3e74-4a40-90bd-94eb6c9df984 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.036425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ec356fb7-33fc-4cb7-98a8-05a4414771ad None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:45.037682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ec356fb7-33fc-4cb7-98a8-05a4414771ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:45.060415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:45.104489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 249/499] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:45.105345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec356fb7-33fc-4cb7-98a8-05a4414771ad None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.122213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6fc24-3e74-4a40-90bd-94eb6c9df984 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.155904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153faf47-8202-4928-86e9-ec72e1c96024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.156704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153faf47-8202-4928-86e9-ec72e1c96024 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.157024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153faf47-8202-4928-86e9-ec72e1c96024 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.157292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153faf47-8202-4928-86e9-ec72e1c96024 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.163272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:45.164780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153faf47-8202-4928-86e9-ec72e1c96024 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:45.166277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153faf47-8202-4928-86e9-ec72e1c96024 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-153faf47-8202-4928-86e9-ec72e1c96024 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:45.181996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:45.182911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:45.183805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 251/500] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:45.184378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153faf47-8202-4928-86e9-ec72e1c96024 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.209451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec356fb7-33fc-4cb7-98a8-05a4414771ad None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.243743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304db07c-a6fd-4448-b509-cd0f7bc86e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.244538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304db07c-a6fd-4448-b509-cd0f7bc86e74 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.244821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304db07c-a6fd-4448-b509-cd0f7bc86e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.245138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304db07c-a6fd-4448-b509-cd0f7bc86e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.255038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304db07c-a6fd-4448-b509-cd0f7bc86e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:45.256557 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304db07c-a6fd-4448-b509-cd0f7bc86e74 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-304db07c-a6fd-4448-b509-cd0f7bc86e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:45.273928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:45.274770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:45.275726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:45.275726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:45.275726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:45.275726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:45.275726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 250/501] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:45.275984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304db07c-a6fd-4448-b509-cd0f7bc86e74 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.281563 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:45.292455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153faf47-8202-4928-86e9-ec72e1c96024 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.328802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de2218-7b36-4357-a73b-560160f9ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.329492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de2218-7b36-4357-a73b-560160f9ccbf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.329772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de2218-7b36-4357-a73b-560160f9ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.330045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de2218-7b36-4357-a73b-560160f9ccbf None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.330768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de2218-7b36-4357-a73b-560160f9ccbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:45.331070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de2218-7b36-4357-a73b-560160f9ccbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:45.332461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de2218-7b36-4357-a73b-560160f9ccbf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.343599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 252/502] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:45.344382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de2218-7b36-4357-a73b-560160f9ccbf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.376201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304db07c-a6fd-4448-b509-cd0f7bc86e74 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.387406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:45.411195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13709570-a594-4312-b9e4-62b9cefcfc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.412013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13709570-a594-4312-b9e4-62b9cefcfc4c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.412277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13709570-a594-4312-b9e4-62b9cefcfc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.412548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13709570-a594-4312-b9e4-62b9cefcfc4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.422519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13709570-a594-4312-b9e4-62b9cefcfc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:45.423984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13709570-a594-4312-b9e4-62b9cefcfc4c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-13709570-a594-4312-b9e4-62b9cefcfc4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:45.441952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:45.442817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:45.443642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:45.443642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:45.443642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:45.443642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:45.443642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 251/503] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:45.444230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13709570-a594-4312-b9e4-62b9cefcfc4c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.448744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de2218-7b36-4357-a73b-560160f9ccbf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.483449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23220b15-a9f6-42cd-9229-3c73bd4a30d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.484248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23220b15-a9f6-42cd-9229-3c73bd4a30d3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.484535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23220b15-a9f6-42cd-9229-3c73bd4a30d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.485446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23220b15-a9f6-42cd-9229-3c73bd4a30d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.495713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23220b15-a9f6-42cd-9229-3c73bd4a30d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-23220b15-a9f6-42cd-9229-3c73bd4a30d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:45.503467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:45.504347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:45.505188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 253/504] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:45.505867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23220b15-a9f6-42cd-9229-3c73bd4a30d3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.529317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:45.549147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13709570-a594-4312-b9e4-62b9cefcfc4c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.583898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9f774-2fa9-4bdf-bc80-225785ad79ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.584586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9f774-2fa9-4bdf-bc80-225785ad79ff None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.584893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9f774-2fa9-4bdf-bc80-225785ad79ff None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.585173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9f774-2fa9-4bdf-bc80-225785ad79ff None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.586012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9f774-2fa9-4bdf-bc80-225785ad79ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:45.586321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9f774-2fa9-4bdf-bc80-225785ad79ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:45.587799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9f774-2fa9-4bdf-bc80-225785ad79ff None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.605510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23220b15-a9f6-42cd-9229-3c73bd4a30d3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.624070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 252/505] 10.222.0.59 () {56 vars in 1137 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:45.624879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9f774-2fa9-4bdf-bc80-225785ad79ff None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.643916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5eaf-9a4a-4253-8719-ebbcf3bb1702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.644572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5eaf-9a4a-4253-8719-ebbcf3bb1702 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.644873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5eaf-9a4a-4253-8719-ebbcf3bb1702 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.645146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a5eaf-9a4a-4253-8719-ebbcf3bb1702 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.645861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5eaf-9a4a-4253-8719-ebbcf3bb1702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:45.646163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5eaf-9a4a-4253-8719-ebbcf3bb1702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:45.646911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:45.647526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a5eaf-9a4a-4253-8719-ebbcf3bb1702 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.659487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 254/506] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:45.660296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5eaf-9a4a-4253-8719-ebbcf3bb1702 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.724571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9f774-2fa9-4bdf-bc80-225785ad79ff None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.740509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:45.760293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a5eaf-9a4a-4253-8719-ebbcf3bb1702 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.760788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9159d-cfbd-4656-b932-82287126d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.761610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9159d-cfbd-4656-b932-82287126d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.761892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9159d-cfbd-4656-b932-82287126d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.762162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9159d-cfbd-4656-b932-82287126d5e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.769343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9159d-cfbd-4656-b932-82287126d5e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:45.770819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9159d-cfbd-4656-b932-82287126d5e2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-67e9159d-cfbd-4656-b932-82287126d5e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:45.786489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:45.787578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:45.788518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 253/507] 10.222.0.59 () {56 vars in 1093 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:45.789115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9159d-cfbd-4656-b932-82287126d5e2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.796869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639c0d4-04c4-44f8-903b-883e74325f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.797554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639c0d4-04c4-44f8-903b-883e74325f93 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.797836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639c0d4-04c4-44f8-903b-883e74325f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.798112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639c0d4-04c4-44f8-903b-883e74325f93 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.798829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639c0d4-04c4-44f8-903b-883e74325f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:45.799136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639c0d4-04c4-44f8-903b-883e74325f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:45.800494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639c0d4-04c4-44f8-903b-883e74325f93 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.811930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 255/508] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:45.812732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639c0d4-04c4-44f8-903b-883e74325f93 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.874494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:45.893847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9159d-cfbd-4656-b932-82287126d5e2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.910186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639c0d4-04c4-44f8-903b-883e74325f93 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:45.927203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91792c-f9bd-46f1-b985-df969d3a76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.927876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91792c-f9bd-46f1-b985-df969d3a76b1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.928151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91792c-f9bd-46f1-b985-df969d3a76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.928420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91792c-f9bd-46f1-b985-df969d3a76b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.929269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91792c-f9bd-46f1-b985-df969d3a76b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:45.929505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91792c-f9bd-46f1-b985-df969d3a76b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:45.930900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91792c-f9bd-46f1-b985-df969d3a76b1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:45.938934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 254/509] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:45.939805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91792c-f9bd-46f1-b985-df969d3a76b1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:45.946003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b1f89-afdd-44ae-8e6b-532127538b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:45.946655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1f89-afdd-44ae-8e6b-532127538b51 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:45.946939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1f89-afdd-44ae-8e6b-532127538b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:45.947216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b1f89-afdd-44ae-8e6b-532127538b51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:45.958086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:46.015240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b1f89-afdd-44ae-8e6b-532127538b51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:46.016709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b1f89-afdd-44ae-8e6b-532127538b51 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:46.037911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91792c-f9bd-46f1-b985-df969d3a76b1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:46.070089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5076e46-714d-4649-bce8-082d46236ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:46.070886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076e46-714d-4649-bce8-082d46236ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:46.071164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076e46-714d-4649-bce8-082d46236ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:46.071435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076e46-714d-4649-bce8-082d46236ed2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:46.079919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5076e46-714d-4649-bce8-082d46236ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:46.081580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5076e46-714d-4649-bce8-082d46236ed2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c5076e46-714d-4649-bce8-082d46236ed2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:46.096049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:46.097166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 16:17:46.098208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:46.100988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 255/510] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:46.101948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5076e46-714d-4649-bce8-082d46236ed2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:46.104683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:46.121715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 256/511] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:46.122547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b1f89-afdd-44ae-8e6b-532127538b51 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:46.163875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:46.212994 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5076e46-714d-4649-bce8-082d46236ed2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:46.221021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b1f89-afdd-44ae-8e6b-532127538b51 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:46.246473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613aeea-3092-4506-9010-fd3d6e9700b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:46.247146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613aeea-3092-4506-9010-fd3d6e9700b7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:46.247423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613aeea-3092-4506-9010-fd3d6e9700b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:46.247698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613aeea-3092-4506-9010-fd3d6e9700b7 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:46.248545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613aeea-3092-4506-9010-fd3d6e9700b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:46.248931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613aeea-3092-4506-9010-fd3d6e9700b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:46.250321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613aeea-3092-4506-9010-fd3d6e9700b7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:46.254607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bce8bc-3f4a-4003-a85e-668e94f69eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:46.255278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bce8bc-3f4a-4003-a85e-668e94f69eba None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:46.255578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bce8bc-3f4a-4003-a85e-668e94f69eba None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:46.255838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bce8bc-3f4a-4003-a85e-668e94f69eba None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:46.256545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bce8bc-3f4a-4003-a85e-668e94f69eba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:46.258022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bce8bc-3f4a-4003-a85e-668e94f69eba None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:46.266976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 256/512] 10.222.0.59 () {56 vars in 1133 bytes} [Fri Jul 1 16:17:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:46.267759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613aeea-3092-4506-9010-fd3d6e9700b7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:46.280419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 257/513] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:17:46 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:17:46.281278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bce8bc-3f4a-4003-a85e-668e94f69eba None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:46.337780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:46.385862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613aeea-3092-4506-9010-fd3d6e9700b7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:46.400494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:46.409997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bce8bc-3f4a-4003-a85e-668e94f69eba None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:46.423569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d22a-0644-4ee1-8923-c10545c2a168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:46.424387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d22a-0644-4ee1-8923-c10545c2a168 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:46.424663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d22a-0644-4ee1-8923-c10545c2a168 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:46.424967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6d22a-0644-4ee1-8923-c10545c2a168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:46.436835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6d22a-0644-4ee1-8923-c10545c2a168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:46.438372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6d22a-0644-4ee1-8923-c10545c2a168 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:46.454441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb248eec-4bd0-43bf-96a7-3b5f54e617f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:46.455123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb248eec-4bd0-43bf-96a7-3b5f54e617f4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:46.455406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb248eec-4bd0-43bf-96a7-3b5f54e617f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:46.455682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb248eec-4bd0-43bf-96a7-3b5f54e617f4 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:46.456531 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb248eec-4bd0-43bf-96a7-3b5f54e617f4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:46.456858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb248eec-4bd0-43bf-96a7-3b5f54e617f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1cb6d22a-0644-4ee1-8923-c10545c2a168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:46.457995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:46.458816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:46.459882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:46.459882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:46.459882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:46.459882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:46.460106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb248eec-4bd0-43bf-96a7-3b5f54e617f4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:46.460176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 257/514] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:46.460454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d22a-0644-4ee1-8923-c10545c2a168 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:46.503775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 258/515] 10.222.0.59 () {56 vars in 1137 bytes} [Fri Jul 1 16:17:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:46.504636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb248eec-4bd0-43bf-96a7-3b5f54e617f4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:46.574908 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6d22a-0644-4ee1-8923-c10545c2a168 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:46.589975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:46.610466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb248eec-4bd0-43bf-96a7-3b5f54e617f4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:46.614870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3d59b-274a-406a-9087-56e163ae8144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:46.615662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3d59b-274a-406a-9087-56e163ae8144 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:46.615946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3d59b-274a-406a-9087-56e163ae8144 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:46.616222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3d59b-274a-406a-9087-56e163ae8144 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:46.626515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3d59b-274a-406a-9087-56e163ae8144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:46.628002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3d59b-274a-406a-9087-56e163ae8144 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:46.646562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15044-29ce-494e-9082-edd0923cf2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-30c3d59b-274a-406a-9087-56e163ae8144 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:46.646860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:46.647669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:46.648490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:46.648490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:46.648490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:46.648490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:46.648707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15044-29ce-494e-9082-edd0923cf2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:46.648707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15044-29ce-494e-9082-edd0923cf2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:46.648707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15044-29ce-494e-9082-edd0923cf2d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:46.649335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 258/516] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:46.649335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3d59b-274a-406a-9087-56e163ae8144 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:46.679283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:46.738199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e15044-29ce-494e-9082-edd0923cf2d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:46.740729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e15044-29ce-494e-9082-edd0923cf2d7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:46.755951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3d59b-274a-406a-9087-56e163ae8144 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:46.792051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110171c-421b-4570-8863-c0d08c1eda61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:46.792722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110171c-421b-4570-8863-c0d08c1eda61 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:46.793028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110171c-421b-4570-8863-c0d08c1eda61 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:46.793304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110171c-421b-4570-8863-c0d08c1eda61 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:46.794034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110171c-421b-4570-8863-c0d08c1eda61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:46.794342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110171c-421b-4570-8863-c0d08c1eda61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:46.795775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110171c-421b-4570-8863-c0d08c1eda61 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:46.808034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 259/517] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:46.808861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110171c-421b-4570-8863-c0d08c1eda61 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:46.834457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:46.854222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 259/518] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:46.859572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15044-29ce-494e-9082-edd0923cf2d7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:46.914686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:46.919072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110171c-421b-4570-8863-c0d08c1eda61 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:46.957487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186112d4-41bc-4c73-a117-ba6298499746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:46.958141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186112d4-41bc-4c73-a117-ba6298499746 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:46.958424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186112d4-41bc-4c73-a117-ba6298499746 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:46.958788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186112d4-41bc-4c73-a117-ba6298499746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:46.968129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15044-29ce-494e-9082-edd0923cf2d7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.006968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf400c5-280a-4423-82f8-1032d79d0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.007933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf400c5-280a-4423-82f8-1032d79d0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.008217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf400c5-280a-4423-82f8-1032d79d0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.008492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf400c5-280a-4423-82f8-1032d79d0fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.009429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf400c5-280a-4423-82f8-1032d79d0fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:47.010117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf400c5-280a-4423-82f8-1032d79d0fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.011523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf400c5-280a-4423-82f8-1032d79d0fc4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.027733 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 260/519] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:47.027733 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf400c5-280a-4423-82f8-1032d79d0fc4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.038252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186112d4-41bc-4c73-a117-ba6298499746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.039840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186112d4-41bc-4c73-a117-ba6298499746 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.065810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:47.131589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf400c5-280a-4423-82f8-1032d79d0fc4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.144697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:47.150554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 260/520] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:47.156901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186112d4-41bc-4c73-a117-ba6298499746 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.171421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc10a6d-9780-49af-a1d4-af5ce3ad43dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.172234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc10a6d-9780-49af-a1d4-af5ce3ad43dd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.172518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc10a6d-9780-49af-a1d4-af5ce3ad43dd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.172798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc10a6d-9780-49af-a1d4-af5ce3ad43dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.180524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc10a6d-9780-49af-a1d4-af5ce3ad43dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.182111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc10a6d-9780-49af-a1d4-af5ce3ad43dd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5dc10a6d-9780-49af-a1d4-af5ce3ad43dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:47.196031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:47.196963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:47.197862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 261/521] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:47.199337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc10a6d-9780-49af-a1d4-af5ce3ad43dd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.260317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186112d4-41bc-4c73-a117-ba6298499746 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.285166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:47.298667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a687664-48c6-465b-894c-fc97b23418b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.299481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a687664-48c6-465b-894c-fc97b23418b6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.299768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a687664-48c6-465b-894c-fc97b23418b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.300034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a687664-48c6-465b-894c-fc97b23418b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.307153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc10a6d-9780-49af-a1d4-af5ce3ad43dd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.310332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a687664-48c6-465b-894c-fc97b23418b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.311914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a687664-48c6-465b-894c-fc97b23418b6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8a687664-48c6-465b-894c-fc97b23418b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:47.329694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:47.330727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:47.331791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:47.331791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:47.331791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:47.331791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:47.333334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 261/522] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:47.334268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a687664-48c6-465b-894c-fc97b23418b6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.349961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480a947-7f78-4972-a0f8-d1d940e4081b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.350896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a947-7f78-4972-a0f8-d1d940e4081b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.351243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a947-7f78-4972-a0f8-d1d940e4081b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.351469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480a947-7f78-4972-a0f8-d1d940e4081b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.359497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480a947-7f78-4972-a0f8-d1d940e4081b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.360993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480a947-7f78-4972-a0f8-d1d940e4081b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-0480a947-7f78-4972-a0f8-d1d940e4081b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:47.376153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:47.377206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:47.378035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:47.378035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:47.378035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:47.378035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:47.378035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:47.378035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:47.378035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:47.378035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:47.382252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 262/523] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:47.383048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480a947-7f78-4972-a0f8-d1d940e4081b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.417553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:47.451519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a687664-48c6-465b-894c-fc97b23418b6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.487943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b9f4c-9db7-4825-a423-331ff437ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.488758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b9f4c-9db7-4825-a423-331ff437ba90 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.489083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b9f4c-9db7-4825-a423-331ff437ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.489366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b9f4c-9db7-4825-a423-331ff437ba90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.491612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480a947-7f78-4972-a0f8-d1d940e4081b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.500104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b9f4c-9db7-4825-a423-331ff437ba90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.501623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b9f4c-9db7-4825-a423-331ff437ba90 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cd4b9f4c-9db7-4825-a423-331ff437ba90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:47.522454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:47.523380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:47.524219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:47.524219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:47.524219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:47.524219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:47.528254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 262/524] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:47.529113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b9f4c-9db7-4825-a423-331ff437ba90 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.530878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c40078-39dd-4af3-9e6f-40e4e4eb2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.531562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c40078-39dd-4af3-9e6f-40e4e4eb2b15 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.531849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c40078-39dd-4af3-9e6f-40e4e4eb2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.532129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c40078-39dd-4af3-9e6f-40e4e4eb2b15 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.533002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c40078-39dd-4af3-9e6f-40e4e4eb2b15 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:47.533311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c40078-39dd-4af3-9e6f-40e4e4eb2b15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.534782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c40078-39dd-4af3-9e6f-40e4e4eb2b15 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.554444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 263/525] 10.222.0.59 () {56 vars in 1139 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:47.555378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c40078-39dd-4af3-9e6f-40e4e4eb2b15 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.562842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:47.648015 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:47.653249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b9f4c-9db7-4825-a423-331ff437ba90 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.658664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c40078-39dd-4af3-9e6f-40e4e4eb2b15 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.688234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd560fb-bb16-406f-a8c8-44f4a8a5f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.688937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd560fb-bb16-406f-a8c8-44f4a8a5f115 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.689222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd560fb-bb16-406f-a8c8-44f4a8a5f115 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.689499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd560fb-bb16-406f-a8c8-44f4a8a5f115 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.690225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd560fb-bb16-406f-a8c8-44f4a8a5f115 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:47.690538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd560fb-bb16-406f-a8c8-44f4a8a5f115 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.691932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd560fb-bb16-406f-a8c8-44f4a8a5f115 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.696637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6a618-4ce9-47d3-ba93-e90ec20237f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.697330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6a618-4ce9-47d3-ba93-e90ec20237f3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.697615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6a618-4ce9-47d3-ba93-e90ec20237f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.697890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6a618-4ce9-47d3-ba93-e90ec20237f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.698676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6a618-4ce9-47d3-ba93-e90ec20237f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:47.699005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6a618-4ce9-47d3-ba93-e90ec20237f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.700424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6a618-4ce9-47d3-ba93-e90ec20237f3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.704258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 263/526] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:47.705374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd560fb-bb16-406f-a8c8-44f4a8a5f115 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.725885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 264/527] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:47.731408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6a618-4ce9-47d3-ba93-e90ec20237f3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.807609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:47.820499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd560fb-bb16-406f-a8c8-44f4a8a5f115 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.836747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6a618-4ce9-47d3-ba93-e90ec20237f3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:47.858801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd4a4a-5ec0-44a0-a3ba-e10737faf78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.859480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd4a4a-5ec0-44a0-a3ba-e10737faf78a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.859762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd4a4a-5ec0-44a0-a3ba-e10737faf78a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.860035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd4a4a-5ec0-44a0-a3ba-e10737faf78a None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.860764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd4a4a-5ec0-44a0-a3ba-e10737faf78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:47.861101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd4a4a-5ec0-44a0-a3ba-e10737faf78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.862498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd4a4a-5ec0-44a0-a3ba-e10737faf78a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.872423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2d39e-4213-49b2-97f2-23948257867e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:47.873109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2d39e-4213-49b2-97f2-23948257867e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:47.873392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2d39e-4213-49b2-97f2-23948257867e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:47.873734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2d39e-4213-49b2-97f2-23948257867e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:47.876962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 264/528] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:47.878778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd4a4a-5ec0-44a0-a3ba-e10737faf78a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:47.897112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:47.947391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2d39e-4213-49b2-97f2-23948257867e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:47.949155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2d39e-4213-49b2-97f2-23948257867e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:47.986020 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd4a4a-5ec0-44a0-a3ba-e10737faf78a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.025754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1bf0e-a6a5-4a5d-83d0-d732e9bc0d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.027264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1bf0e-a6a5-4a5d-83d0-d732e9bc0d17 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.027749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1bf0e-a6a5-4a5d-83d0-d732e9bc0d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.028532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1bf0e-a6a5-4a5d-83d0-d732e9bc0d17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.037434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1bf0e-a6a5-4a5d-83d0-d732e9bc0d17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.039532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1bf0e-a6a5-4a5d-83d0-d732e9bc0d17 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.051683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 265/529] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:48.052551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2d39e-4213-49b2-97f2-23948257867e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cbf1bf0e-a6a5-4a5d-83d0-d732e9bc0d17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:48.057217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:48.058110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:48.059077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:48.059077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:48.059077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:48.059077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:48.059077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:48.059077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:48.059077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:48.059077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:48.060799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 265/530] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:48.061716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1bf0e-a6a5-4a5d-83d0-d732e9bc0d17 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.076291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:48.116486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:48.164993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2d39e-4213-49b2-97f2-23948257867e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.174025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1bf0e-a6a5-4a5d-83d0-d732e9bc0d17 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.202321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb724c2-51ff-425c-959a-b4e36b7217e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.202902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb724c2-51ff-425c-959a-b4e36b7217e2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.203198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb724c2-51ff-425c-959a-b4e36b7217e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.203465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb724c2-51ff-425c-959a-b4e36b7217e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.204309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb724c2-51ff-425c-959a-b4e36b7217e2 None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=87a4ed0881004eef94166ace450b8a63) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:48.204616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb724c2-51ff-425c-959a-b4e36b7217e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.206121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb724c2-51ff-425c-959a-b4e36b7217e2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.209975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196e6b5-16bd-4b5d-9884-d74d8f7c92db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.210786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196e6b5-16bd-4b5d-9884-d74d8f7c92db None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.211070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196e6b5-16bd-4b5d-9884-d74d8f7c92db None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.211349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196e6b5-16bd-4b5d-9884-d74d8f7c92db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.211842 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 266/531] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/role_assignments?user.id=87a4ed0881004eef94166ace450b8a63&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:48.212627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb724c2-51ff-425c-959a-b4e36b7217e2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.229000 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196e6b5-16bd-4b5d-9884-d74d8f7c92db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.230992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196e6b5-16bd-4b5d-9884-d74d8f7c92db None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c196e6b5-16bd-4b5d-9884-d74d8f7c92db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:48.248462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:48.249402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:48.250222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:48.250222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:48.250222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:48.250222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:48.250222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:48.250222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:48.250222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:48.250222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:48.250222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 266/532] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:48.250683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196e6b5-16bd-4b5d-9884-d74d8f7c92db None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.339714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb724c2-51ff-425c-959a-b4e36b7217e2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.351097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:48.359173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:48.380061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b432d0-8152-47ef-9872-2ef79f087f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.380904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b432d0-8152-47ef-9872-2ef79f087f9d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.381308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b432d0-8152-47ef-9872-2ef79f087f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.381580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b432d0-8152-47ef-9872-2ef79f087f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.390743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196e6b5-16bd-4b5d-9884-d74d8f7c92db None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.396236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b432d0-8152-47ef-9872-2ef79f087f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.398185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b432d0-8152-47ef-9872-2ef79f087f9d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b7b432d0-8152-47ef-9872-2ef79f087f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:48.418376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:48.419286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:48.420159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:48.420159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:48.420159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:48.420159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:48.420159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 267/533] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:48.420433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b432d0-8152-47ef-9872-2ef79f087f9d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.439276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fce6f-acf7-4ec4-a7b5-5399e05b6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.439983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fce6f-acf7-4ec4-a7b5-5399e05b6f8d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.440473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fce6f-acf7-4ec4-a7b5-5399e05b6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.440759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fce6f-acf7-4ec4-a7b5-5399e05b6f8d None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.442046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fce6f-acf7-4ec4-a7b5-5399e05b6f8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:48.442360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fce6f-acf7-4ec4-a7b5-5399e05b6f8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.443873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fce6f-acf7-4ec4-a7b5-5399e05b6f8d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.464217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 267/534] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:48.465493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66d0d6-7384-4e09-8d4d-a801d8259586 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.465784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66d0d6-7384-4e09-8d4d-a801d8259586 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.466062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66d0d6-7384-4e09-8d4d-a801d8259586 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.467496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 268/535] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:48.468036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66d0d6-7384-4e09-8d4d-a801d8259586 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.535964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b432d0-8152-47ef-9872-2ef79f087f9d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.571164 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1542-8e20-4bb0-bfb6-db56515b6420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.572001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1542-8e20-4bb0-bfb6-db56515b6420 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.572647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1542-8e20-4bb0-bfb6-db56515b6420 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.572935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac1542-8e20-4bb0-bfb6-db56515b6420 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.573777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac1542-8e20-4bb0-bfb6-db56515b6420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:48.574103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac1542-8e20-4bb0-bfb6-db56515b6420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.575656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac1542-8e20-4bb0-bfb6-db56515b6420 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.576073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66d0d6-7384-4e09-8d4d-a801d8259586 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.595072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 268/536] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:48.595072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1542-8e20-4bb0-bfb6-db56515b6420 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.610793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:48.619149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91765e-c7f2-44bb-823c-635415b41707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.619956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91765e-c7f2-44bb-823c-635415b41707 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.620246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91765e-c7f2-44bb-823c-635415b41707 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.620518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91765e-c7f2-44bb-823c-635415b41707 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.620703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:48.621275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91765e-c7f2-44bb-823c-635415b41707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:48.621581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91765e-c7f2-44bb-823c-635415b41707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.622999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91765e-c7f2-44bb-823c-635415b41707 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.639688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 269/537] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:48.641072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2af74-96ae-434c-9954-b6a46cabe4e4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.641366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2af74-96ae-434c-9954-b6a46cabe4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.641656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2af74-96ae-434c-9954-b6a46cabe4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.658474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eed2af74-96ae-434c-9954-b6a46cabe4e4 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:48.659680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eed2af74-96ae-434c-9954-b6a46cabe4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:48.697617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac1542-8e20-4bb0-bfb6-db56515b6420 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.743648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae7c2-3795-4570-819b-e5e4c087190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.744343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 270/538] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:48.744443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae7c2-3795-4570-819b-e5e4c087190e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.744443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae7c2-3795-4570-819b-e5e4c087190e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.744567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2af74-96ae-434c-9954-b6a46cabe4e4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.744632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae7c2-3795-4570-819b-e5e4c087190e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.744632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ae7c2-3795-4570-819b-e5e4c087190e None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=efdfb91ba4c04452ba547baa184185c4) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:48.744632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ae7c2-3795-4570-819b-e5e4c087190e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.744632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ae7c2-3795-4570-819b-e5e4c087190e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.753127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 269/539] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/role_assignments?user.id=efdfb91ba4c04452ba547baa184185c4&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:48.754204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae7c2-3795-4570-819b-e5e4c087190e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.870744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2af74-96ae-434c-9954-b6a46cabe4e4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.873754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:48.885588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae7c2-3795-4570-819b-e5e4c087190e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:48.893142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:48.912293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375096f3-265d-4c8c-b0e1-167636f03a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.913331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375096f3-265d-4c8c-b0e1-167636f03a02 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.913825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375096f3-265d-4c8c-b0e1-167636f03a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.914388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375096f3-265d-4c8c-b0e1-167636f03a02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.915296 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375096f3-265d-4c8c-b0e1-167636f03a02 None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=c4980d7e51e84655add2a53808818598) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:48.915672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375096f3-265d-4c8c-b0e1-167636f03a02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.917198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375096f3-265d-4c8c-b0e1-167636f03a02 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.926462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26dde-4f24-42b0-b2f5-9243516adc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:48.927280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26dde-4f24-42b0-b2f5-9243516adc39 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:48.927560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26dde-4f24-42b0-b2f5-9243516adc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:48.927835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b26dde-4f24-42b0-b2f5-9243516adc39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:48.928992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 271/540] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/role_assignments?user.id=c4980d7e51e84655add2a53808818598&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:48.930137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375096f3-265d-4c8c-b0e1-167636f03a02 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:48.935998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b26dde-4f24-42b0-b2f5-9243516adc39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:48.937666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b26dde-4f24-42b0-b2f5-9243516adc39 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-07b26dde-4f24-42b0-b2f5-9243516adc39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:48.956123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:48.957101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:48.957970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:48.957970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:48.957970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:48.957970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:48.957970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:48.957970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:48.957970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:48.957970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:48.957970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 270/541] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:48.964123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26dde-4f24-42b0-b2f5-9243516adc39 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:49.112329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b26dde-4f24-42b0-b2f5-9243516adc39 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:49.152607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1995a-0c64-4047-837f-d06fc30388a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:49.153551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1995a-0c64-4047-837f-d06fc30388a3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:49.153976 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1995a-0c64-4047-837f-d06fc30388a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:49.154444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1995a-0c64-4047-837f-d06fc30388a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:49.155422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1995a-0c64-4047-837f-d06fc30388a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:49.155871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1995a-0c64-4047-837f-d06fc30388a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:49.157504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1995a-0c64-4047-837f-d06fc30388a3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:49.171890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 271/542] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:49.178118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1995a-0c64-4047-837f-d06fc30388a3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:49.194134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:49.215446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375096f3-265d-4c8c-b0e1-167636f03a02 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:49.276122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d72bc-bf62-42ec-982a-086ca1674c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:49.276965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d72bc-bf62-42ec-982a-086ca1674c22 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:49.277245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d72bc-bf62-42ec-982a-086ca1674c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:49.277517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d72bc-bf62-42ec-982a-086ca1674c22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:49.306389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d72bc-bf62-42ec-982a-086ca1674c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6d1d72bc-bf62-42ec-982a-086ca1674c22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:49.315142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:49.316023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:49.316815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:49.317464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 272/543] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:49.324790 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d72bc-bf62-42ec-982a-086ca1674c22 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:49.364704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1995a-0c64-4047-837f-d06fc30388a3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:49.393223 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:49.431673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723fc66-cab1-42df-b60a-364ef195250a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:49.432340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723fc66-cab1-42df-b60a-364ef195250a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:49.432617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723fc66-cab1-42df-b60a-364ef195250a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:49.432910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723fc66-cab1-42df-b60a-364ef195250a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:49.433756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723fc66-cab1-42df-b60a-364ef195250a None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=11785acde2f74ad481d1224f2a7fd296) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:49.434060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723fc66-cab1-42df-b60a-364ef195250a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:49.435524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723fc66-cab1-42df-b60a-364ef195250a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:49.450305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 272/544] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:49 2022] GET /identity/v3/role_assignments?user.id=11785acde2f74ad481d1224f2a7fd296&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:49.491551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d72bc-bf62-42ec-982a-086ca1674c22 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:49.551058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a79a3-a188-4373-9f42-b7f79cff792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:49.551761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a79a3-a188-4373-9f42-b7f79cff792a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:49.552044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a79a3-a188-4373-9f42-b7f79cff792a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:49.552317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a79a3-a188-4373-9f42-b7f79cff792a None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:49.553114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a79a3-a188-4373-9f42-b7f79cff792a None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:49.553424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a79a3-a188-4373-9f42-b7f79cff792a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:49.554859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a79a3-a188-4373-9f42-b7f79cff792a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:49.569225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 273/545] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:49.575777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723fc66-cab1-42df-b60a-364ef195250a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:49.674692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:49.707518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723fc66-cab1-42df-b60a-364ef195250a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:49.769083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091f14c-4e5f-4c5c-9561-dde9a6cb1194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:49.770271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091f14c-4e5f-4c5c-9561-dde9a6cb1194 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:49.770774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091f14c-4e5f-4c5c-9561-dde9a6cb1194 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:49.771246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091f14c-4e5f-4c5c-9561-dde9a6cb1194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:49.789022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091f14c-4e5f-4c5c-9561-dde9a6cb1194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:49.790797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091f14c-4e5f-4c5c-9561-dde9a6cb1194 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5091f14c-4e5f-4c5c-9561-dde9a6cb1194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:49.811628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:49.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:49.813422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:49.813422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:49.813422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:49.813422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:49.815310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 273/546] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:49.821995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a79a3-a188-4373-9f42-b7f79cff792a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:49.985417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a79a3-a188-4373-9f42-b7f79cff792a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:49.987687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:50.031488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73268bfb-dc50-4b7e-bc4c-c15a1c7ea46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:50.032171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73268bfb-dc50-4b7e-bc4c-c15a1c7ea46a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:50.032456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73268bfb-dc50-4b7e-bc4c-c15a1c7ea46a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:50.032733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73268bfb-dc50-4b7e-bc4c-c15a1c7ea46a None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:50.033493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73268bfb-dc50-4b7e-bc4c-c15a1c7ea46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:50.033801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73268bfb-dc50-4b7e-bc4c-c15a1c7ea46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:50.035201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73268bfb-dc50-4b7e-bc4c-c15a1c7ea46a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:50.052323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 274/547] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:50.058085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091f14c-4e5f-4c5c-9561-dde9a6cb1194 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:50.179176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091f14c-4e5f-4c5c-9561-dde9a6cb1194 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:50.206414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:50.219368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d7ece-45f5-4c75-9d0e-e2ecd3587ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:50.220188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d7ece-45f5-4c75-9d0e-e2ecd3587ede None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:50.220464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d7ece-45f5-4c75-9d0e-e2ecd3587ede None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:50.220734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d7ece-45f5-4c75-9d0e-e2ecd3587ede None admin] PATH_INFO: `/v3/users/swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:50.228943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d7ece-45f5-4c75-9d0e-e2ecd3587ede None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:50.230402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d7ece-45f5-4c75-9d0e-e2ecd3587ede None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-370d7ece-45f5-4c75-9d0e-e2ecd3587ede None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:50.244770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:50.245761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:50.247168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 274/548] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:17:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:50.251789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73268bfb-dc50-4b7e-bc4c-c15a1c7ea46a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:50.421078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73268bfb-dc50-4b7e-bc4c-c15a1c7ea46a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:50.473107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54a14a-c112-469a-a4f3-4134da09bd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:50.474199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54a14a-c112-469a-a4f3-4134da09bd91 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:50.474703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54a14a-c112-469a-a4f3-4134da09bd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:50.475189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54a14a-c112-469a-a4f3-4134da09bd91 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:50.476224 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54a14a-c112-469a-a4f3-4134da09bd91 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:50.476729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54a14a-c112-469a-a4f3-4134da09bd91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:50.478571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54a14a-c112-469a-a4f3-4134da09bd91 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:50.500417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e195a-355a-4a2d-b675-0f7e905f09bd None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:50.500616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e195a-355a-4a2d-b675-0f7e905f09bd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:50.500904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e195a-355a-4a2d-b675-0f7e905f09bd None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:50.502334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 275/549] 10.222.0.59 () {56 vars in 1135 bytes} [Fri Jul 1 16:17:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:50.505840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 275/550] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:50.508211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e195a-355a-4a2d-b675-0f7e905f09bd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:50.508490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0afdd3-6aad-4db0-b658-27d98db1ac65 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:50.508778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0afdd3-6aad-4db0-b658-27d98db1ac65 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:50.509079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0afdd3-6aad-4db0-b658-27d98db1ac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:50.532705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0c0afdd3-6aad-4db0-b658-27d98db1ac65 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:50.533929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0c0afdd3-6aad-4db0-b658-27d98db1ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:50.568396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:50.656947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e195a-355a-4a2d-b675-0f7e905f09bd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:50.678376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 276/551] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:50.713656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ae28c-8343-4bb6-8488-65295ad8c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:50.714327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae28c-8343-4bb6-8488-65295ad8c9ca None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:50.714608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae28c-8343-4bb6-8488-65295ad8c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:50.714885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ae28c-8343-4bb6-8488-65295ad8c9ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:50.719226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0afdd3-6aad-4db0-b658-27d98db1ac65 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:50.796904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:50.817357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ae28c-8343-4bb6-8488-65295ad8c9ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:50.819154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ae28c-8343-4bb6-8488-65295ad8c9ca None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:50.860173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0afdd3-6aad-4db0-b658-27d98db1ac65 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:50.896191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3c50-2589-499b-ad9b-c19af10d02c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:50.897092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3c50-2589-499b-ad9b-c19af10d02c2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:50.897379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3c50-2589-499b-ad9b-c19af10d02c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:50.897726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b3c50-2589-499b-ad9b-c19af10d02c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:50.909604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b3c50-2589-499b-ad9b-c19af10d02c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-874b3c50-2589-499b-ad9b-c19af10d02c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:50.925680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:50.926655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:50.927559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 277/552] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:50.933297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3c50-2589-499b-ad9b-c19af10d02c2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:50.949262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:50.998888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 276/553] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:51.014271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ae28c-8343-4bb6-8488-65295ad8c9ca None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:51.056904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b3c50-2589-499b-ad9b-c19af10d02c2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.091782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478ddff-61f5-498e-9421-d28dfc8d6572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:51.092762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478ddff-61f5-498e-9421-d28dfc8d6572 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.093256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478ddff-61f5-498e-9421-d28dfc8d6572 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.093687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478ddff-61f5-498e-9421-d28dfc8d6572 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.094630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478ddff-61f5-498e-9421-d28dfc8d6572 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:51.095084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478ddff-61f5-498e-9421-d28dfc8d6572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:51.096623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478ddff-61f5-498e-9421-d28dfc8d6572 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:51.109099 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 278/554] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:51.111569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478ddff-61f5-498e-9421-d28dfc8d6572 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:51.189839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:51.192116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ae28c-8343-4bb6-8488-65295ad8c9ca None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.205212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:51.215855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478ddff-61f5-498e-9421-d28dfc8d6572 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.228622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645c8ce-6b44-4684-8fed-73b70904de48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:51.229548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c8ce-6b44-4684-8fed-73b70904de48 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.229899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c8ce-6b44-4684-8fed-73b70904de48 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.230240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645c8ce-6b44-4684-8fed-73b70904de48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.241963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c8ce-6b44-4684-8fed-73b70904de48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:51.243539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645c8ce-6b44-4684-8fed-73b70904de48 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:51.253505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df617c5-d02e-4e3f-8510-6564f60d8209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:51.254506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df617c5-d02e-4e3f-8510-6564f60d8209 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.254964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df617c5-d02e-4e3f-8510-6564f60d8209 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.255405 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df617c5-d02e-4e3f-8510-6564f60d8209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c645c8ce-6b44-4684-8fed-73b70904de48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:51.266422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:51.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:51.268179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:51.268179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:51.268179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:51.268179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:51.269203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df617c5-d02e-4e3f-8510-6564f60d8209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:51.270829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df617c5-d02e-4e3f-8510-6564f60d8209 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:51.272486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 277/555] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:51.274172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390352d6-a358-4e8d-8978-ffd7b8037bc3 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.274474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390352d6-a358-4e8d-8978-ffd7b8037bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.274828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390352d6-a358-4e8d-8978-ffd7b8037bc3 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.276449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 278/556] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:51.277238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390352d6-a358-4e8d-8978-ffd7b8037bc3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3df617c5-d02e-4e3f-8510-6564f60d8209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:51.290634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:51.291524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:51.292966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:51.292966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:51.292966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:51.292966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:51.294989 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 279/557] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:51.297470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad76384-d3e1-4d76-828c-9bdd05b599e2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.297948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad76384-d3e1-4d76-828c-9bdd05b599e2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.301697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad76384-d3e1-4d76-828c-9bdd05b599e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.319038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-aad76384-d3e1-4d76-828c-9bdd05b599e2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:51.320541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aad76384-d3e1-4d76-828c-9bdd05b599e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:51.393145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390352d6-a358-4e8d-8978-ffd7b8037bc3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.393768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 280/558] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:51.394812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad76384-d3e1-4d76-828c-9bdd05b599e2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:51.449416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa7d5-e316-4df1-8320-5c91b7b960ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:51.450085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa7d5-e316-4df1-8320-5c91b7b960ed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.450360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa7d5-e316-4df1-8320-5c91b7b960ed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.450688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa7d5-e316-4df1-8320-5c91b7b960ed None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.451930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fa7d5-e316-4df1-8320-5c91b7b960ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:51.452239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fa7d5-e316-4df1-8320-5c91b7b960ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:51.453965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607fa7d5-e316-4df1-8320-5c91b7b960ed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:51.465357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:51.468222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:51.473113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 279/559] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:51.473884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa7d5-e316-4df1-8320-5c91b7b960ed None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:51.529487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad76384-d3e1-4d76-828c-9bdd05b599e2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.566934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985069a-1071-48f1-9fd5-3f0a59c10b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:51.567668 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985069a-1071-48f1-9fd5-3f0a59c10b0a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.567972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985069a-1071-48f1-9fd5-3f0a59c10b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.568285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985069a-1071-48f1-9fd5-3f0a59c10b0a None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.569013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985069a-1071-48f1-9fd5-3f0a59c10b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:51.569518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985069a-1071-48f1-9fd5-3f0a59c10b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:51.570785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985069a-1071-48f1-9fd5-3f0a59c10b0a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:51.582616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa7d5-e316-4df1-8320-5c91b7b960ed None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.588208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 281/560] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:51.588208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c30ad-e8bf-4b35-b88c-7d973df180c5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.588208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c30ad-e8bf-4b35-b88c-7d973df180c5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.588208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c30ad-e8bf-4b35-b88c-7d973df180c5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.588777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 282/561] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:51.593086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c30ad-e8bf-4b35-b88c-7d973df180c5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:51.619462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31b75c-7dd0-4032-9681-0845d9dd481c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:51.620517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31b75c-7dd0-4032-9681-0845d9dd481c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.620517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31b75c-7dd0-4032-9681-0845d9dd481c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.620801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31b75c-7dd0-4032-9681-0845d9dd481c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.635448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31b75c-7dd0-4032-9681-0845d9dd481c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ac31b75c-7dd0-4032-9681-0845d9dd481c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:51.643202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:51.644197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 280/562] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:51.645589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31b75c-7dd0-4032-9681-0845d9dd481c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:51.712102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:51.716322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c30ad-e8bf-4b35-b88c-7d973df180c5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.733806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:51.755644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461ac1a-371c-407e-8537-409708713c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:51.756768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461ac1a-371c-407e-8537-409708713c7e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.757162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461ac1a-371c-407e-8537-409708713c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.757430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461ac1a-371c-407e-8537-409708713c7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.764964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31b75c-7dd0-4032-9681-0845d9dd481c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.765148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461ac1a-371c-407e-8537-409708713c7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:51.766538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461ac1a-371c-407e-8537-409708713c7e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5461ac1a-371c-407e-8537-409708713c7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:51.780839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:51.781768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:51.782646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:51.782646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:51.782646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:51.782646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:51.782646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:51.782646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:51.782646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:51.782646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:51.782646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 283/563] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:51.783745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c995-0da1-4e90-91a9-605fa00974c9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.783745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c995-0da1-4e90-91a9-605fa00974c9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.783995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c995-0da1-4e90-91a9-605fa00974c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.801009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fa63c995-0da1-4e90-91a9-605fa00974c9 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:51.802199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fa63c995-0da1-4e90-91a9-605fa00974c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:51.804489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfc6c3-3fdc-4f6b-84b3-d49134c6c383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:51.805323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfc6c3-3fdc-4f6b-84b3-d49134c6c383 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.805605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfc6c3-3fdc-4f6b-84b3-d49134c6c383 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.805902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfc6c3-3fdc-4f6b-84b3-d49134c6c383 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.814033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfc6c3-3fdc-4f6b-84b3-d49134c6c383 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:51.815477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfc6c3-3fdc-4f6b-84b3-d49134c6c383 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e7bfc6c3-3fdc-4f6b-84b3-d49134c6c383 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:51.829655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:51.830788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 281/564] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:51.831913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfc6c3-3fdc-4f6b-84b3-d49134c6c383 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:51.871927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 284/565] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:51.872854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63c995-0da1-4e90-91a9-605fa00974c9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:51.930799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfc6c3-3fdc-4f6b-84b3-d49134c6c383 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.950069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:51.964732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0114fc11-c5e1-4f2e-9ac6-65a8142cb8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:51.965436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114fc11-c5e1-4f2e-9ac6-65a8142cb8cf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.965720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114fc11-c5e1-4f2e-9ac6-65a8142cb8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.966000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0114fc11-c5e1-4f2e-9ac6-65a8142cb8cf None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.966777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114fc11-c5e1-4f2e-9ac6-65a8142cb8cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:51.967509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114fc11-c5e1-4f2e-9ac6-65a8142cb8cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:51.968561 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0114fc11-c5e1-4f2e-9ac6-65a8142cb8cf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:51.972288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63c995-0da1-4e90-91a9-605fa00974c9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:51.976407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 282/566] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:51.977764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46afe60-776f-4354-8466-0abcd3cb246d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:51.978055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46afe60-776f-4354-8466-0abcd3cb246d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:51.978340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46afe60-776f-4354-8466-0abcd3cb246d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:51.979690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:51.979927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 283/567] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:51.981070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46afe60-776f-4354-8466-0abcd3cb246d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.012083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b4c24-cf9e-412b-8aed-bc70b2fd065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.013231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b4c24-cf9e-412b-8aed-bc70b2fd065d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.013786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b4c24-cf9e-412b-8aed-bc70b2fd065d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.014303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b4c24-cf9e-412b-8aed-bc70b2fd065d None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.015386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b4c24-cf9e-412b-8aed-bc70b2fd065d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:52.015698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b4c24-cf9e-412b-8aed-bc70b2fd065d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:52.017173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b4c24-cf9e-412b-8aed-bc70b2fd065d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:52.030029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 285/568] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:52.030626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b4c24-cf9e-412b-8aed-bc70b2fd065d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.086236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46afe60-776f-4354-8466-0abcd3cb246d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.120467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d8d55-203e-433a-86ae-bfde050ecb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.121161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d8d55-203e-433a-86ae-bfde050ecb9c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.121436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d8d55-203e-433a-86ae-bfde050ecb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.121704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d8d55-203e-433a-86ae-bfde050ecb9c None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.122579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d8d55-203e-433a-86ae-bfde050ecb9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:52.122903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d8d55-203e-433a-86ae-bfde050ecb9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:52.124309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d8d55-203e-433a-86ae-bfde050ecb9c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:52.134490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b4c24-cf9e-412b-8aed-bc70b2fd065d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.141712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 284/569] 10.222.0.59 () {56 vars in 1137 bytes} [Fri Jul 1 16:17:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:52.142504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d8d55-203e-433a-86ae-bfde050ecb9c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.171724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2014-b4e7-4785-ba71-4d25b1223e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.172526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2014-b4e7-4785-ba71-4d25b1223e1a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.172799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2014-b4e7-4785-ba71-4d25b1223e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.173099 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2014-b4e7-4785-ba71-4d25b1223e1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.183538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c2014-b4e7-4785-ba71-4d25b1223e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-de1c2014-b4e7-4785-ba71-4d25b1223e1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:52.191201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:52.192119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:52.192978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 286/570] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:52.193784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f74b4-05b0-40ad-b90d-e2ccd463896d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.194036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f74b4-05b0-40ad-b90d-e2ccd463896d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.194305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f74b4-05b0-40ad-b90d-e2ccd463896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.198712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:52.211051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3a1f74b4-05b0-40ad-b90d-e2ccd463896d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:52.212241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3a1f74b4-05b0-40ad-b90d-e2ccd463896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:52.233729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:52.256245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d8d55-203e-433a-86ae-bfde050ecb9c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.282685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 287/571] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:52.283544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f74b4-05b0-40ad-b90d-e2ccd463896d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.292614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7cc56-5ea2-4e17-9d7b-755edccc5330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.293434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7cc56-5ea2-4e17-9d7b-755edccc5330 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.293709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7cc56-5ea2-4e17-9d7b-755edccc5330 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.293977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7cc56-5ea2-4e17-9d7b-755edccc5330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.305258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7cc56-5ea2-4e17-9d7b-755edccc5330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:52.306728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7cc56-5ea2-4e17-9d7b-755edccc5330 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4ed7cc56-5ea2-4e17-9d7b-755edccc5330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:52.324190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:52.325108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:52.326001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:52.326001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:52.326001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:52.326001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:52.326001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 285/572] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:52.326714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7cc56-5ea2-4e17-9d7b-755edccc5330 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.390850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f74b4-05b0-40ad-b90d-e2ccd463896d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.415547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:52.424235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7cc56-5ea2-4e17-9d7b-755edccc5330 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.424708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee1fa-f650-4b03-bee9-db849f36689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.425412 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee1fa-f650-4b03-bee9-db849f36689d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.425726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee1fa-f650-4b03-bee9-db849f36689d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.426004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dee1fa-f650-4b03-bee9-db849f36689d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.426845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dee1fa-f650-4b03-bee9-db849f36689d None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=7db0ec167b464cfea43931cd3c6183e9) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:52.427160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dee1fa-f650-4b03-bee9-db849f36689d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:52.428678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dee1fa-f650-4b03-bee9-db849f36689d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:52.434105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 288/573] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/role_assignments?user.id=7db0ec167b464cfea43931cd3c6183e9&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:52.434880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee1fa-f650-4b03-bee9-db849f36689d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.459379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:52.478210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de15187-6c0e-4374-bd30-321040b61d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.479075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de15187-6c0e-4374-bd30-321040b61d1d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.479358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de15187-6c0e-4374-bd30-321040b61d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.479629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de15187-6c0e-4374-bd30-321040b61d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.491534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de15187-6c0e-4374-bd30-321040b61d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:52.493074 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de15187-6c0e-4374-bd30-321040b61d1d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-0de15187-6c0e-4374-bd30-321040b61d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:52.512385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:52.513404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:52.514423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:52.514423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:52.514423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:52.514423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:52.514423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 286/574] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:52.514708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de15187-6c0e-4374-bd30-321040b61d1d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.556061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dee1fa-f650-4b03-bee9-db849f36689d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.596431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10ac94-a461-469e-88ed-edd68f731e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.597148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10ac94-a461-469e-88ed-edd68f731e6c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.597433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10ac94-a461-469e-88ed-edd68f731e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.597712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10ac94-a461-469e-88ed-edd68f731e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.598467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10ac94-a461-469e-88ed-edd68f731e6c None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:52.598773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10ac94-a461-469e-88ed-edd68f731e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:52.600164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10ac94-a461-469e-88ed-edd68f731e6c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:52.609598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 289/575] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:52.610421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10ac94-a461-469e-88ed-edd68f731e6c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.638193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de15187-6c0e-4374-bd30-321040b61d1d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.673430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201483a-57c4-436b-802d-308dc256f954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.674538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201483a-57c4-436b-802d-308dc256f954 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.675009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201483a-57c4-436b-802d-308dc256f954 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.675308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201483a-57c4-436b-802d-308dc256f954 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.686361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8201483a-57c4-436b-802d-308dc256f954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8201483a-57c4-436b-802d-308dc256f954 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:52.694432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:52.695353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:52.696185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 287/576] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:52.696901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201483a-57c4-436b-802d-308dc256f954 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.701303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:52.705761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:52.724191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10ac94-a461-469e-88ed-edd68f731e6c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.768831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a15cf-a9ac-42ea-b905-69db54f67658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.769524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a15cf-a9ac-42ea-b905-69db54f67658 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.769803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a15cf-a9ac-42ea-b905-69db54f67658 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.770073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a15cf-a9ac-42ea-b905-69db54f67658 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.770792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a15cf-a9ac-42ea-b905-69db54f67658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:52.771093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a15cf-a9ac-42ea-b905-69db54f67658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:52.772477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a15cf-a9ac-42ea-b905-69db54f67658 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:52.785170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 290/577] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:52.790300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a15cf-a9ac-42ea-b905-69db54f67658 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.805498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201483a-57c4-436b-802d-308dc256f954 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.840081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff8efb-14b6-4d6a-b507-b9eb5ee922d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.840836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff8efb-14b6-4d6a-b507-b9eb5ee922d4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.841208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff8efb-14b6-4d6a-b507-b9eb5ee922d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.841554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff8efb-14b6-4d6a-b507-b9eb5ee922d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.842384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff8efb-14b6-4d6a-b507-b9eb5ee922d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:52.842756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff8efb-14b6-4d6a-b507-b9eb5ee922d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:52.844196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff8efb-14b6-4d6a-b507-b9eb5ee922d4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:52.861488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 288/578] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:52.861488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff8efb-14b6-4d6a-b507-b9eb5ee922d4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:52.899887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a15cf-a9ac-42ea-b905-69db54f67658 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.924718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:52.938127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df635faf-7c30-4ea0-9c3a-af7848cce759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:52.938931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df635faf-7c30-4ea0-9c3a-af7848cce759 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:52.939208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df635faf-7c30-4ea0-9c3a-af7848cce759 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:52.939478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df635faf-7c30-4ea0-9c3a-af7848cce759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:52.950285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df635faf-7c30-4ea0-9c3a-af7848cce759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:52.951811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df635faf-7c30-4ea0-9c3a-af7848cce759 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:52.953579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:52.966881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff8efb-14b6-4d6a-b507-b9eb5ee922d4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-df635faf-7c30-4ea0-9c3a-af7848cce759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:52.969947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:52.971008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:52.972095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:52.972095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:52.972095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:52.972095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:52.972095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 291/579] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:52.972095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df635faf-7c30-4ea0-9c3a-af7848cce759 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.011794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d356b7-7d51-4a46-9354-656dde8f7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.012992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d356b7-7d51-4a46-9354-656dde8f7578 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.013409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d356b7-7d51-4a46-9354-656dde8f7578 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.013885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d356b7-7d51-4a46-9354-656dde8f7578 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.014871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d356b7-7d51-4a46-9354-656dde8f7578 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:53.015312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d356b7-7d51-4a46-9354-656dde8f7578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.016955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d356b7-7d51-4a46-9354-656dde8f7578 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.030147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 289/580] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:53.031216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d356b7-7d51-4a46-9354-656dde8f7578 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.071624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df635faf-7c30-4ea0-9c3a-af7848cce759 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.107331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9439c1-644c-4ee5-9b30-6abba002a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.108139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9439c1-644c-4ee5-9b30-6abba002a899 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.108418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9439c1-644c-4ee5-9b30-6abba002a899 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.108691 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9439c1-644c-4ee5-9b30-6abba002a899 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.116032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9439c1-644c-4ee5-9b30-6abba002a899 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.117531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9439c1-644c-4ee5-9b30-6abba002a899 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3d9439c1-644c-4ee5-9b30-6abba002a899 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:53.131716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:53.132831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:17:53.133915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:53.137993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 292/581] 10.222.0.59 () {56 vars in 1093 bytes} [Fri Jul 1 16:17:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:53.138529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9439c1-644c-4ee5-9b30-6abba002a899 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.143863 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d356b7-7d51-4a46-9354-656dde8f7578 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.169518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:53.180759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4863f-ad6f-43bc-951e-77b29879ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.181506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4863f-ad6f-43bc-951e-77b29879ff4b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.181782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4863f-ad6f-43bc-951e-77b29879ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.182050 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab4863f-ad6f-43bc-951e-77b29879ff4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.188951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4863f-ad6f-43bc-951e-77b29879ff4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.190393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab4863f-ad6f-43bc-951e-77b29879ff4b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-9ab4863f-ad6f-43bc-951e-77b29879ff4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:53.205179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:53.209129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:53.210029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:53.210029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:53.210029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:53.210029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:53.210029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:53.210029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:53.210029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:53.210029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:53.210457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:53.210530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 290/582] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:53.210530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4863f-ad6f-43bc-951e-77b29879ff4b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.259827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9439c1-644c-4ee5-9b30-6abba002a899 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.294824 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3255691-f60f-43fd-943b-9e081892dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.295499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3255691-f60f-43fd-943b-9e081892dba0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.295781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3255691-f60f-43fd-943b-9e081892dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.296056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3255691-f60f-43fd-943b-9e081892dba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.296780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3255691-f60f-43fd-943b-9e081892dba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:53.297114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3255691-f60f-43fd-943b-9e081892dba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.298522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3255691-f60f-43fd-943b-9e081892dba0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.310696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 293/583] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:53.311486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3255691-f60f-43fd-943b-9e081892dba0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.312299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab4863f-ad6f-43bc-951e-77b29879ff4b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.354973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827e354-cb51-4b78-a49a-7c423f5266b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.355769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827e354-cb51-4b78-a49a-7c423f5266b3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.356062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827e354-cb51-4b78-a49a-7c423f5266b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.356338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827e354-cb51-4b78-a49a-7c423f5266b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.367101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827e354-cb51-4b78-a49a-7c423f5266b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.368559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827e354-cb51-4b78-a49a-7c423f5266b3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a827e354-cb51-4b78-a49a-7c423f5266b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:53.386223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:53.387210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:53.388093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:53.388093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:53.388093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:53.388093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:53.388093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 291/584] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:53.388376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827e354-cb51-4b78-a49a-7c423f5266b3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.424471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3255691-f60f-43fd-943b-9e081892dba0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.428771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:53.439108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:53.462187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397a9c6-8505-4a1e-b5d9-83ce01e84388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.462866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397a9c6-8505-4a1e-b5d9-83ce01e84388 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.463148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397a9c6-8505-4a1e-b5d9-83ce01e84388 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.463421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397a9c6-8505-4a1e-b5d9-83ce01e84388 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.464253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397a9c6-8505-4a1e-b5d9-83ce01e84388 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:53.464561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397a9c6-8505-4a1e-b5d9-83ce01e84388 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.466063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397a9c6-8505-4a1e-b5d9-83ce01e84388 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.486509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 294/585] 10.222.0.59 () {56 vars in 1133 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:53.487421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397a9c6-8505-4a1e-b5d9-83ce01e84388 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.499560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827e354-cb51-4b78-a49a-7c423f5266b3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.538782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69e80c-3135-4e2e-b6aa-74bb49359283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.539457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69e80c-3135-4e2e-b6aa-74bb49359283 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.539738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69e80c-3135-4e2e-b6aa-74bb49359283 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.540022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69e80c-3135-4e2e-b6aa-74bb49359283 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.540814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69e80c-3135-4e2e-b6aa-74bb49359283 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:53.541169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69e80c-3135-4e2e-b6aa-74bb49359283 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.542611 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69e80c-3135-4e2e-b6aa-74bb49359283 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.560909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 292/586] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:53.560909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69e80c-3135-4e2e-b6aa-74bb49359283 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.600869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397a9c6-8505-4a1e-b5d9-83ce01e84388 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.640145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f4d50-545b-4f69-afc2-b1d22cf519e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.641051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f4d50-545b-4f69-afc2-b1d22cf519e2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.641327 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f4d50-545b-4f69-afc2-b1d22cf519e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.641595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f4d50-545b-4f69-afc2-b1d22cf519e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.650070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f4d50-545b-4f69-afc2-b1d22cf519e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.651735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f4d50-545b-4f69-afc2-b1d22cf519e2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.665466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4c1f4d50-545b-4f69-afc2-b1d22cf519e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:53.668039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:53.669114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 16:17:53.675663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:53.676329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69e80c-3135-4e2e-b6aa-74bb49359283 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.676423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 295/587] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:53.676423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f4d50-545b-4f69-afc2-b1d22cf519e2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.707158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:53.714849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07988e8-2a11-419a-b698-d7897676cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.715514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07988e8-2a11-419a-b698-d7897676cf3e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.715792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07988e8-2a11-419a-b698-d7897676cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.716065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07988e8-2a11-419a-b698-d7897676cf3e None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.716815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07988e8-2a11-419a-b698-d7897676cf3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:53.717233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07988e8-2a11-419a-b698-d7897676cf3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.718632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07988e8-2a11-419a-b698-d7897676cf3e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.736028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 293/588] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:53.736028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07988e8-2a11-419a-b698-d7897676cf3e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.793360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f4d50-545b-4f69-afc2-b1d22cf519e2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.840477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eece6-a16f-454e-9a62-36985643ba3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.841500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eece6-a16f-454e-9a62-36985643ba3a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.841948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eece6-a16f-454e-9a62-36985643ba3a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.842445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eece6-a16f-454e-9a62-36985643ba3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.842578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07988e8-2a11-419a-b698-d7897676cf3e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:53.856265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eece6-a16f-454e-9a62-36985643ba3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.858884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7eece6-a16f-454e-9a62-36985643ba3a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-fe7eece6-a16f-454e-9a62-36985643ba3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:53.878007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:53.879149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:53.880348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:53.880348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:53.880348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:53.880348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:53.881063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 296/589] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:53.881886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eece6-a16f-454e-9a62-36985643ba3a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.888803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64dd8b-fdbf-43c3-b6ce-9703a30bff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:53.889752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64dd8b-fdbf-43c3-b6ce-9703a30bff3e None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:53.890037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64dd8b-fdbf-43c3-b6ce-9703a30bff3e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:53.890312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64dd8b-fdbf-43c3-b6ce-9703a30bff3e None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/87a4ed0881004eef94166ace450b8a63/roles/9802e06a85874fc98135684e38cb3a41` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:53.908008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64dd8b-fdbf-43c3-b6ce-9703a30bff3e None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=87a4ed0881004eef94166ace450b8a63, role_id=9802e06a85874fc98135684e38cb3a41)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:53.910023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64dd8b-fdbf-43c3-b6ce-9703a30bff3e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:53.924395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 294/590] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:53 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/87a4ed0881004eef94166ace450b8a63/roles/9802e06a85874fc98135684e38cb3a41 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:53.925390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64dd8b-fdbf-43c3-b6ce-9703a30bff3e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:53.950309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:53.998381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:54.023577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7eece6-a16f-454e-9a62-36985643ba3a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:54.071688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1fa52-1edf-4e83-80e4-ba63a8a1c791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:54.072396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1fa52-1edf-4e83-80e4-ba63a8a1c791 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.072678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1fa52-1edf-4e83-80e4-ba63a8a1c791 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.073427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1fa52-1edf-4e83-80e4-ba63a8a1c791 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.073958 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1fa52-1edf-4e83-80e4-ba63a8a1c791 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:54.074272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1fa52-1edf-4e83-80e4-ba63a8a1c791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:54.076015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1fa52-1edf-4e83-80e4-ba63a8a1c791 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:54.099842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 297/591] 10.222.0.59 () {56 vars in 1137 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:54.100036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64dd8b-fdbf-43c3-b6ce-9703a30bff3e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:54.100142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1fa52-1edf-4e83-80e4-ba63a8a1c791 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:54.146465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f92a16-64f5-4fe9-80b9-5b6940f116cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:54.147300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f92a16-64f5-4fe9-80b9-5b6940f116cb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.147569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f92a16-64f5-4fe9-80b9-5b6940f116cb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.147834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f92a16-64f5-4fe9-80b9-5b6940f116cb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.164128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f92a16-64f5-4fe9-80b9-5b6940f116cb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:54.166447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f92a16-64f5-4fe9-80b9-5b6940f116cb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e0f92a16-64f5-4fe9-80b9-5b6940f116cb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:54.187278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:54.188379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 16:17:54.189326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:54.192939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 295/592] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:54.194323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f92a16-64f5-4fe9-80b9-5b6940f116cb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:54.241580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1fa52-1edf-4e83-80e4-ba63a8a1c791 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:54.288278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:54.300809 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00df7f-8ace-4773-ba39-a8440826e6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:54.301890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00df7f-8ace-4773-ba39-a8440826e6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.302374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00df7f-8ace-4773-ba39-a8440826e6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.302963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00df7f-8ace-4773-ba39-a8440826e6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.303886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00df7f-8ace-4773-ba39-a8440826e6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:54.304481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00df7f-8ace-4773-ba39-a8440826e6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:54.306150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00df7f-8ace-4773-ba39-a8440826e6f8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:54.322516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 298/593] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:54.323806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00df7f-8ace-4773-ba39-a8440826e6f8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:54.327442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:54.331087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f92a16-64f5-4fe9-80b9-5b6940f116cb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:54.374528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e04ef-39e9-467d-995a-990514c51811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:54.375329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e04ef-39e9-467d-995a-990514c51811 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.375784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e04ef-39e9-467d-995a-990514c51811 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.376059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e04ef-39e9-467d-995a-990514c51811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.387701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e04ef-39e9-467d-995a-990514c51811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:54.389042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e04ef-39e9-467d-995a-990514c51811 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-8d7e04ef-39e9-467d-995a-990514c51811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:54.408001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:54.408991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:54.410118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:54.410118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:54.410118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:54.410118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:54.411013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 296/594] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:54.412024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e04ef-39e9-467d-995a-990514c51811 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:54.455931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00df7f-8ace-4773-ba39-a8440826e6f8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:54.501181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493bf4a-d923-400a-99e4-6e215d1fb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:54.502222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493bf4a-d923-400a-99e4-6e215d1fb67e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.502647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493bf4a-d923-400a-99e4-6e215d1fb67e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.503060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493bf4a-d923-400a-99e4-6e215d1fb67e None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.504081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493bf4a-d923-400a-99e4-6e215d1fb67e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:54.504717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493bf4a-d923-400a-99e4-6e215d1fb67e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:54.506564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493bf4a-d923-400a-99e4-6e215d1fb67e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:54.521293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e04ef-39e9-467d-995a-990514c51811 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:54.530125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 299/595] 10.222.0.59 () {56 vars in 1139 bytes} [Fri Jul 1 16:17:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:54.531399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493bf4a-d923-400a-99e4-6e215d1fb67e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:54.543236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:54.558440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662f6ab-5d6d-49fa-9a59-857a63b9e9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:54.559263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662f6ab-5d6d-49fa-9a59-857a63b9e9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.559540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662f6ab-5d6d-49fa-9a59-857a63b9e9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.559808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662f6ab-5d6d-49fa-9a59-857a63b9e9c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.567686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662f6ab-5d6d-49fa-9a59-857a63b9e9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:54.569835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662f6ab-5d6d-49fa-9a59-857a63b9e9c8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-2662f6ab-5d6d-49fa-9a59-857a63b9e9c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:54.583873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:54.584835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:54.585764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:54.585764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:54.585764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:54.585764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:54.585764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:54.585764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:54.585764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:54.585764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:54.585764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 297/596] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:54.586726 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79d13a-435b-4bc5-8616-1440e4d01733 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.587008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79d13a-435b-4bc5-8616-1440e4d01733 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.587280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79d13a-435b-4bc5-8616-1440e4d01733 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.592625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 298/597] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:54.592625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79d13a-435b-4bc5-8616-1440e4d01733 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:54.608532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:54.655465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493bf4a-d923-400a-99e4-6e215d1fb67e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:54.695036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25db5c-7562-449e-add1-e1be6adcce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:54.695715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25db5c-7562-449e-add1-e1be6adcce9a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.695999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25db5c-7562-449e-add1-e1be6adcce9a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.696276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25db5c-7562-449e-add1-e1be6adcce9a None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.697039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25db5c-7562-449e-add1-e1be6adcce9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:54.697349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25db5c-7562-449e-add1-e1be6adcce9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:54.698749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25db5c-7562-449e-add1-e1be6adcce9a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:54.710424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 300/598] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:54.711252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25db5c-7562-449e-add1-e1be6adcce9a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:54.731323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79d13a-435b-4bc5-8616-1440e4d01733 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:54.776666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2425d-558c-4aae-bae3-ff9e9d26c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:54.777658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2425d-558c-4aae-bae3-ff9e9d26c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.777930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2425d-558c-4aae-bae3-ff9e9d26c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.778202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2425d-558c-4aae-bae3-ff9e9d26c8b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.789348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2425d-558c-4aae-bae3-ff9e9d26c8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:54.790813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2425d-558c-4aae-bae3-ff9e9d26c8b9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-dee2425d-558c-4aae-bae3-ff9e9d26c8b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:54.810103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:54.811099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:54.812009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:54.812009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:54.812009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:54.812009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:54.812009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 299/599] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:54.812878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817099d-5602-4941-9753-1f96af1c9ca6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.812878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817099d-5602-4941-9753-1f96af1c9ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.813128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817099d-5602-4941-9753-1f96af1c9ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.830541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9817099d-5602-4941-9753-1f96af1c9ca6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:54.831749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9817099d-5602-4941-9753-1f96af1c9ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:54.835172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25db5c-7562-449e-add1-e1be6adcce9a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:54.855268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:54.862567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:54.872304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321585be-5f86-4923-96d0-09cac2efaf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:54.873798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321585be-5f86-4923-96d0-09cac2efaf66 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:54.874078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321585be-5f86-4923-96d0-09cac2efaf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:54.874349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321585be-5f86-4923-96d0-09cac2efaf66 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:54.875139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321585be-5f86-4923-96d0-09cac2efaf66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:54.875443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321585be-5f86-4923-96d0-09cac2efaf66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:54.876939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321585be-5f86-4923-96d0-09cac2efaf66 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:54.893122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 301/600] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:54.894069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321585be-5f86-4923-96d0-09cac2efaf66 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:54.908623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 300/601] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:54.909715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817099d-5602-4941-9753-1f96af1c9ca6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.011203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321585be-5f86-4923-96d0-09cac2efaf66 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.011546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817099d-5602-4941-9753-1f96af1c9ca6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.046831 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd513438-f81f-4680-9100-f810a6f034bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.047496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd513438-f81f-4680-9100-f810a6f034bc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.047776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd513438-f81f-4680-9100-f810a6f034bc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.048084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd513438-f81f-4680-9100-f810a6f034bc None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.048809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd513438-f81f-4680-9100-f810a6f034bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:55.049149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd513438-f81f-4680-9100-f810a6f034bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:55.050535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd513438-f81f-4680-9100-f810a6f034bc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:55.055062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482f533-06bf-438c-a3ea-e3a30d750fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.055907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482f533-06bf-438c-a3ea-e3a30d750fff None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.056187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482f533-06bf-438c-a3ea-e3a30d750fff None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.056456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482f533-06bf-438c-a3ea-e3a30d750fff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.067013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 301/602] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:55.067180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482f533-06bf-438c-a3ea-e3a30d750fff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:55.067261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd513438-f81f-4680-9100-f810a6f034bc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.067332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482f533-06bf-438c-a3ea-e3a30d750fff None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8482f533-06bf-438c-a3ea-e3a30d750fff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:55.079685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:55.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:55.081494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:55.081494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:55.081494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:55.081494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:55.081494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:55.081494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:55.081494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:55.081494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:55.081494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 302/603] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:55.082130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482f533-06bf-438c-a3ea-e3a30d750fff None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.094980 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:55.130578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:55.178453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd513438-f81f-4680-9100-f810a6f034bc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.190636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482f533-06bf-438c-a3ea-e3a30d750fff None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.218064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5616d8d-ed91-4936-a02f-c4bd269d8acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.218965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5616d8d-ed91-4936-a02f-c4bd269d8acc None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.219247 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5616d8d-ed91-4936-a02f-c4bd269d8acc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.219668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5616d8d-ed91-4936-a02f-c4bd269d8acc None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/efdfb91ba4c04452ba547baa184185c4/roles/9802e06a85874fc98135684e38cb3a41` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.224111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f876-d873-478c-855c-b884eff75eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.224930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f876-d873-478c-855c-b884eff75eff None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.225208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f876-d873-478c-855c-b884eff75eff None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.225476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f876-d873-478c-855c-b884eff75eff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.234841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5616d8d-ed91-4936-a02f-c4bd269d8acc None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=efdfb91ba4c04452ba547baa184185c4, role_id=9802e06a85874fc98135684e38cb3a41)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:55.236166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0f876-d873-478c-855c-b884eff75eff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:55.236285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5616d8d-ed91-4936-a02f-c4bd269d8acc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d7e0f876-d873-478c-855c-b884eff75eff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:55.243828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:55.249748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 303/604] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:55.250593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f876-d873-478c-855c-b884eff75eff None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.256466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 302/605] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:55 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/efdfb91ba4c04452ba547baa184185c4/roles/9802e06a85874fc98135684e38cb3a41 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:55.257329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5616d8d-ed91-4936-a02f-c4bd269d8acc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.362861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:55.375430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:55.379310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f876-d873-478c-855c-b884eff75eff None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.407582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5616d8d-ed91-4936-a02f-c4bd269d8acc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.421855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4945-7366-4bab-a301-16ae9ffd3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.422978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4945-7366-4bab-a301-16ae9ffd3a2d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.423461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4945-7366-4bab-a301-16ae9ffd3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.424023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4945-7366-4bab-a301-16ae9ffd3a2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.432358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4945-7366-4bab-a301-16ae9ffd3a2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:55.434088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4945-7366-4bab-a301-16ae9ffd3a2d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:55.446526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee5c9-c34b-409d-82f9-712cf5d17d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.447195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee5c9-c34b-409d-82f9-712cf5d17d9e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.447477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee5c9-c34b-409d-82f9-712cf5d17d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.447752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee5c9-c34b-409d-82f9-712cf5d17d9e None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.448541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ee5c9-c34b-409d-82f9-712cf5d17d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:55.448876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ee5c9-c34b-409d-82f9-712cf5d17d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e99d4945-7366-4bab-a301-16ae9ffd3a2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:55.449395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:55.450246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:55.451150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:55.451150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:55.451150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:55.451150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:55.451150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:55.451150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:55.451150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:55.451150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:55.451586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ee5c9-c34b-409d-82f9-712cf5d17d9e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:55.451656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 304/606] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:55.452156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4945-7366-4bab-a301-16ae9ffd3a2d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.469095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 303/607] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:55.469095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee5c9-c34b-409d-82f9-712cf5d17d9e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.584196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee5c9-c34b-409d-82f9-712cf5d17d9e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.596053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4945-7366-4bab-a301-16ae9ffd3a2d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.615916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:55.621941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9fee7-5a6f-433f-bfd3-e96ed2e9468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.623174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9fee7-5a6f-433f-bfd3-e96ed2e9468d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.623894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9fee7-5a6f-433f-bfd3-e96ed2e9468d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.624496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9fee7-5a6f-433f-bfd3-e96ed2e9468d None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.625501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9fee7-5a6f-433f-bfd3-e96ed2e9468d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:55.625910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9fee7-5a6f-433f-bfd3-e96ed2e9468d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:55.627621 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9fee7-5a6f-433f-bfd3-e96ed2e9468d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:55.641037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 304/608] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:55.642007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9fee7-5a6f-433f-bfd3-e96ed2e9468d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.644837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa065f5-6beb-4258-821d-24227dcc98c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.646665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa065f5-6beb-4258-821d-24227dcc98c0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.647101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa065f5-6beb-4258-821d-24227dcc98c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.647521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa065f5-6beb-4258-821d-24227dcc98c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.648492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa065f5-6beb-4258-821d-24227dcc98c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:55.648982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa065f5-6beb-4258-821d-24227dcc98c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:55.650553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa065f5-6beb-4258-821d-24227dcc98c0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:55.667961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 305/609] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:55.669395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa065f5-6beb-4258-821d-24227dcc98c0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.702072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:55.775966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9fee7-5a6f-433f-bfd3-e96ed2e9468d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.786226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa065f5-6beb-4258-821d-24227dcc98c0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:55.826657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540555f-67f5-476a-a792-7ef18648c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.827218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c54860-3f8f-4433-97b3-25fcf78ab0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:55.827545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540555f-67f5-476a-a792-7ef18648c9e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.827821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540555f-67f5-476a-a792-7ef18648c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.828087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540555f-67f5-476a-a792-7ef18648c9e7 None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/11785acde2f74ad481d1224f2a7fd296/roles/9802e06a85874fc98135684e38cb3a41` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.828898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c54860-3f8f-4433-97b3-25fcf78ab0c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:55.829484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c54860-3f8f-4433-97b3-25fcf78ab0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:55.829900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c54860-3f8f-4433-97b3-25fcf78ab0c7 None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/c4980d7e51e84655add2a53808818598/roles/9802e06a85874fc98135684e38cb3a41` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:55.843434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540555f-67f5-476a-a792-7ef18648c9e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=11785acde2f74ad481d1224f2a7fd296, role_id=9802e06a85874fc98135684e38cb3a41)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:55.844948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540555f-67f5-476a-a792-7ef18648c9e7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:55.849990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c54860-3f8f-4433-97b3-25fcf78ab0c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=c4980d7e51e84655add2a53808818598, role_id=9802e06a85874fc98135684e38cb3a41)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:55.851579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c54860-3f8f-4433-97b3-25fcf78ab0c7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:55.869202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 306/611] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:55 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/11785acde2f74ad481d1224f2a7fd296/roles/9802e06a85874fc98135684e38cb3a41 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:55.870670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540555f-67f5-476a-a792-7ef18648c9e7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:55.871232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 305/611] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:55 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/c4980d7e51e84655add2a53808818598/roles/9802e06a85874fc98135684e38cb3a41 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:56.000444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:56.032917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5960d-24d8-4482-82f6-9bb796d162dd None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:56.033447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5960d-24d8-4482-82f6-9bb796d162dd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:56.034229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5960d-24d8-4482-82f6-9bb796d162dd None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:56.037020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 306/612] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:17:56.043157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d86f-b121-4088-84d3-c6ccd7e221c5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:56.043517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540555f-67f5-476a-a792-7ef18648c9e7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:56.043855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d86f-b121-4088-84d3-c6ccd7e221c5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:56.044304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76d86f-b121-4088-84d3-c6ccd7e221c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:56.064523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2a76d86f-b121-4088-84d3-c6ccd7e221c5 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:56.066045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2a76d86f-b121-4088-84d3-c6ccd7e221c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:56.081382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902087f-4830-4731-803c-e72807f54026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:56.082187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902087f-4830-4731-803c-e72807f54026 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:56.082464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902087f-4830-4731-803c-e72807f54026 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:56.082727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902087f-4830-4731-803c-e72807f54026 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:56.096291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902087f-4830-4731-803c-e72807f54026 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:56.098242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902087f-4830-4731-803c-e72807f54026 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:56.114814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4902087f-4830-4731-803c-e72807f54026 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:56.119184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:56.120155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:56.125685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:56.125685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:56.125685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:56.125685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:56.125685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 307/613] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:56.128655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902087f-4830-4731-803c-e72807f54026 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:56.216032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 307/614] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:17:56.244956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76d86f-b121-4088-84d3-c6ccd7e221c5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:56.261885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902087f-4830-4731-803c-e72807f54026 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:56.294290 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:56.323385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff848f-cc4e-4138-82d2-805273bc0fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:56.324435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff848f-cc4e-4138-82d2-805273bc0fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:56.324962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff848f-cc4e-4138-82d2-805273bc0fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:56.325496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff848f-cc4e-4138-82d2-805273bc0fe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:56.326503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff848f-cc4e-4138-82d2-805273bc0fe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:56.327001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff848f-cc4e-4138-82d2-805273bc0fe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:56.328576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff848f-cc4e-4138-82d2-805273bc0fe2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:56.353771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 308/615] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:56.360700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff848f-cc4e-4138-82d2-805273bc0fe2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:56.400302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76d86f-b121-4088-84d3-c6ccd7e221c5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:56.490180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe5279-b084-476b-9739-e4ce8907b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:56.491022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe5279-b084-476b-9739-e4ce8907b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:56.491301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe5279-b084-476b-9739-e4ce8907b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:56.491584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe5279-b084-476b-9739-e4ce8907b0b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:56.510130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff848f-cc4e-4138-82d2-805273bc0fe2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:56.520489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe5279-b084-476b-9739-e4ce8907b0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-cdbe5279-b084-476b-9739-e4ce8907b0b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:56.528512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:56.529529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:56.530359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:56.536901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 308/616] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:56.537812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe5279-b084-476b-9739-e4ce8907b0b9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:56.570470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4019b66-3c42-48fb-b32f-213cbcdcad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:56.571298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4019b66-3c42-48fb-b32f-213cbcdcad92 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:56.571583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4019b66-3c42-48fb-b32f-213cbcdcad92 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:56.571860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4019b66-3c42-48fb-b32f-213cbcdcad92 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:56.584690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4019b66-3c42-48fb-b32f-213cbcdcad92 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:56.587503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4019b66-3c42-48fb-b32f-213cbcdcad92 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f4019b66-3c42-48fb-b32f-213cbcdcad92 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:56.602514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:56.603520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:56.605104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 309/617] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:17:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:56.609965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4019b66-3c42-48fb-b32f-213cbcdcad92 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:56.617196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:56.693494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:56.764233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4019b66-3c42-48fb-b32f-213cbcdcad92 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:56.783288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe5279-b084-476b-9739-e4ce8907b0b9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:56.807247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b982449-b588-445e-9d61-6667d86b3193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:56.807931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b982449-b588-445e-9d61-6667d86b3193 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:56.808212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b982449-b588-445e-9d61-6667d86b3193 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:56.808483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b982449-b588-445e-9d61-6667d86b3193 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:56.812190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b982449-b588-445e-9d61-6667d86b3193 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:56.812510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b982449-b588-445e-9d61-6667d86b3193 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:56.814249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b982449-b588-445e-9d61-6667d86b3193 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:56.834317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 310/618] 10.222.0.59 () {56 vars in 1135 bytes} [Fri Jul 1 16:17:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:17:56.840036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b982449-b588-445e-9d61-6667d86b3193 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:56.877555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b469ee-9e2e-49c9-89eb-7916b2c6c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:56.878243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b469ee-9e2e-49c9-89eb-7916b2c6c264 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:56.878526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b469ee-9e2e-49c9-89eb-7916b2c6c264 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:56.878800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b469ee-9e2e-49c9-89eb-7916b2c6c264 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:56.879556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b469ee-9e2e-49c9-89eb-7916b2c6c264 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:56.879863 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b469ee-9e2e-49c9-89eb-7916b2c6c264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:56.881287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b469ee-9e2e-49c9-89eb-7916b2c6c264 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:56.911140 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 309/619] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:56.917944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b469ee-9e2e-49c9-89eb-7916b2c6c264 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:56.947706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b982449-b588-445e-9d61-6667d86b3193 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:56.977379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:56.987090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec30e7-7964-4110-acc4-f6c434299c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:56.988335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec30e7-7964-4110-acc4-f6c434299c3e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:56.988627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec30e7-7964-4110-acc4-f6c434299c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:56.988940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec30e7-7964-4110-acc4-f6c434299c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.000005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec30e7-7964-4110-acc4-f6c434299c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:57.001748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec30e7-7964-4110-acc4-f6c434299c3e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-88ec30e7-7964-4110-acc4-f6c434299c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:57.027843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:57.030184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:57.032313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:57.032313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:57.032313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:57.032313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:57.032313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 311/620] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:17:57.038915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec30e7-7964-4110-acc4-f6c434299c3e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:57.120934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b469ee-9e2e-49c9-89eb-7916b2c6c264 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:57.141203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:57.165829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf66fe-5965-48bc-807e-1eebee2a6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:57.166655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf66fe-5965-48bc-807e-1eebee2a6ead None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.166943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf66fe-5965-48bc-807e-1eebee2a6ead None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.167221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf66fe-5965-48bc-807e-1eebee2a6ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.190731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf66fe-5965-48bc-807e-1eebee2a6ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:57.192221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdf66fe-5965-48bc-807e-1eebee2a6ead None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:57.194562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec30e7-7964-4110-acc4-f6c434299c3e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-fcdf66fe-5965-48bc-807e-1eebee2a6ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:57.228314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:57.229259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:57.230175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:57.230175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:57.230175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:57.230175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:57.230175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 310/621] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:57.237981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf66fe-5965-48bc-807e-1eebee2a6ead None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:57.266282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd674c-ca75-4d2a-bd4f-01f0e87050b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:57.267659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd674c-ca75-4d2a-bd4f-01f0e87050b9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.268145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd674c-ca75-4d2a-bd4f-01f0e87050b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.268618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd674c-ca75-4d2a-bd4f-01f0e87050b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.269617 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd674c-ca75-4d2a-bd4f-01f0e87050b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:57.270206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd674c-ca75-4d2a-bd4f-01f0e87050b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:57.271810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd674c-ca75-4d2a-bd4f-01f0e87050b9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:57.299114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 312/622] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:57.305614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd674c-ca75-4d2a-bd4f-01f0e87050b9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:57.345863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:57.371892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf66fe-5965-48bc-807e-1eebee2a6ead None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:57.408014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708d0a9-db1a-4bea-bec2-ea264a6f65db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:57.409521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708d0a9-db1a-4bea-bec2-ea264a6f65db None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.410007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708d0a9-db1a-4bea-bec2-ea264a6f65db None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.410539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708d0a9-db1a-4bea-bec2-ea264a6f65db None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.411599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708d0a9-db1a-4bea-bec2-ea264a6f65db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:57.412155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708d0a9-db1a-4bea-bec2-ea264a6f65db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:57.413768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708d0a9-db1a-4bea-bec2-ea264a6f65db None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:57.426996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 311/623] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:57.433829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708d0a9-db1a-4bea-bec2-ea264a6f65db None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:57.443221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:57.548134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd674c-ca75-4d2a-bd4f-01f0e87050b9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:57.577638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708d0a9-db1a-4bea-bec2-ea264a6f65db None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:57.593115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6c99-4701-46e6-bb00-15951dcda3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:57.593939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6c99-4701-46e6-bb00-15951dcda3de None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.594218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6c99-4701-46e6-bb00-15951dcda3de None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.594491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6c99-4701-46e6-bb00-15951dcda3de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.603090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6c99-4701-46e6-bb00-15951dcda3de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:57.604553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea6c99-4701-46e6-bb00-15951dcda3de None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:57.619885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70def0-9fe9-405e-a0f4-32ecae96e1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:57.621031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70def0-9fe9-405e-a0f4-32ecae96e1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.621516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70def0-9fe9-405e-a0f4-32ecae96e1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b6ea6c99-4701-46e6-bb00-15951dcda3de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:57.621936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:57.622897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:57.623786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:57.623786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:57.623786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:57.623786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:57.623786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:57.623786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:57.623786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:57.623786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:57.623786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 313/624] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:57.624834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70def0-9fe9-405e-a0f4-32ecae96e1e4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.624966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e209-7ec9-4304-b565-2a3123a56011 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.625197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e209-7ec9-4304-b565-2a3123a56011 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.625465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e209-7ec9-4304-b565-2a3123a56011 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.628913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 314/625] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:57.629874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e209-7ec9-4304-b565-2a3123a56011 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:57.638854 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70def0-9fe9-405e-a0f4-32ecae96e1e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:57.640827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d70def0-9fe9-405e-a0f4-32ecae96e1e4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-7d70def0-9fe9-405e-a0f4-32ecae96e1e4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:57.660101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:57.661136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 01 16:17:57.662094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:57.664953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 312/626] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:17:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:57.666484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86946c6-2492-49a0-8aec-b3aca3fdece2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.666774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86946c6-2492-49a0-8aec-b3aca3fdece2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.667051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86946c6-2492-49a0-8aec-b3aca3fdece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.688582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b86946c6-2492-49a0-8aec-b3aca3fdece2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:57.690156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b86946c6-2492-49a0-8aec-b3aca3fdece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:57.720696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:57.749145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e209-7ec9-4304-b565-2a3123a56011 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:57.758014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:57.776963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 313/627] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:57.778387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86946c6-2492-49a0-8aec-b3aca3fdece2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:57.786351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55efc4-dbc6-42df-9424-96af4727f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:57.787132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55efc4-dbc6-42df-9424-96af4727f715 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.787418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55efc4-dbc6-42df-9424-96af4727f715 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.787695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55efc4-dbc6-42df-9424-96af4727f715 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.788636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55efc4-dbc6-42df-9424-96af4727f715 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:57.792066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55efc4-dbc6-42df-9424-96af4727f715 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:57.792066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55efc4-dbc6-42df-9424-96af4727f715 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:57.804145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 315/628] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:57.810821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55efc4-dbc6-42df-9424-96af4727f715 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:57.922921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55efc4-dbc6-42df-9424-96af4727f715 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:57.924787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86946c6-2492-49a0-8aec-b3aca3fdece2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:57.963333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cd358-cd4c-475c-8857-936b12640998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:57.964268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cd358-cd4c-475c-8857-936b12640998 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.964547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cd358-cd4c-475c-8857-936b12640998 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.964821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cd358-cd4c-475c-8857-936b12640998 None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/7db0ec167b464cfea43931cd3c6183e9/roles/9802e06a85874fc98135684e38cb3a41` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.967569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:57.977758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317aee3-8907-460a-b317-a3b10384eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:57.978902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317aee3-8907-460a-b317-a3b10384eef6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:57.979683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317aee3-8907-460a-b317-a3b10384eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:57.980109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317aee3-8907-460a-b317-a3b10384eef6 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:57.981789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317aee3-8907-460a-b317-a3b10384eef6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:57.982396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317aee3-8907-460a-b317-a3b10384eef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:57.982943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cd358-cd4c-475c-8857-936b12640998 None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=7db0ec167b464cfea43931cd3c6183e9, role_id=9802e06a85874fc98135684e38cb3a41)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:57.984173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317aee3-8907-460a-b317-a3b10384eef6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:57.984597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cd358-cd4c-475c-8857-936b12640998 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:58.008898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 316/629] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:17:57 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/7db0ec167b464cfea43931cd3c6183e9/roles/9802e06a85874fc98135684e38cb3a41 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:17:58.008898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cd358-cd4c-475c-8857-936b12640998 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:58.016008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 314/630] 10.222.0.59 () {56 vars in 1137 bytes} [Fri Jul 1 16:17:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:58.017263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317aee3-8907-460a-b317-a3b10384eef6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:58.156946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:58.208885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cd358-cd4c-475c-8857-936b12640998 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:58.215799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317aee3-8907-460a-b317-a3b10384eef6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:58.256289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854ac63-4367-4d2f-b65f-18b7d550a1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:58.257230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ac63-4367-4d2f-b65f-18b7d550a1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.257512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ac63-4367-4d2f-b65f-18b7d550a1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.257789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854ac63-4367-4d2f-b65f-18b7d550a1c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.263340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9f25e-bf5f-4f39-b027-a1e63179ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:58.264498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9f25e-bf5f-4f39-b027-a1e63179ca01 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.265278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9f25e-bf5f-4f39-b027-a1e63179ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.265783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9f25e-bf5f-4f39-b027-a1e63179ca01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.268799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854ac63-4367-4d2f-b65f-18b7d550a1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d854ac63-4367-4d2f-b65f-18b7d550a1c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:58.276980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:58.277918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:58.278754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 317/631] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:58.280092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed860b6-82e0-4a0d-9f54-889bc9c69ecf None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.280256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed860b6-82e0-4a0d-9f54-889bc9c69ecf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.280488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed860b6-82e0-4a0d-9f54-889bc9c69ecf None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.282231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 318/632] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:58.284252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed860b6-82e0-4a0d-9f54-889bc9c69ecf None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:58.335145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:58.355473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9f25e-bf5f-4f39-b027-a1e63179ca01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:58.357400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9f25e-bf5f-4f39-b027-a1e63179ca01 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:58.393730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed860b6-82e0-4a0d-9f54-889bc9c69ecf None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:58.415537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:58.428363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3e29e-6df0-4726-b71a-908af17abe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:58.429302 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3e29e-6df0-4726-b71a-908af17abe62 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.429579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3e29e-6df0-4726-b71a-908af17abe62 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.429845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3e29e-6df0-4726-b71a-908af17abe62 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.430626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3e29e-6df0-4726-b71a-908af17abe62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:58.430929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3e29e-6df0-4726-b71a-908af17abe62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:58.432336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3e29e-6df0-4726-b71a-908af17abe62 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:58.445996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 319/633] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:58.447320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c423b-8de7-4217-bb1a-9f89b5aedeb6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.447665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c423b-8de7-4217-bb1a-9f89b5aedeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.447998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c423b-8de7-4217-bb1a-9f89b5aedeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.464446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 315/634] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:17:58.466097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838485-dca1-4991-aff1-c079add55821 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.466578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838485-dca1-4991-aff1-c079add55821 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.466859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab838485-dca1-4991-aff1-c079add55821 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.471740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 316/635] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:17:58.471740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838485-dca1-4991-aff1-c079add55821 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:58.473347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-891c423b-8de7-4217-bb1a-9f89b5aedeb6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:58.474792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-891c423b-8de7-4217-bb1a-9f89b5aedeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:58.548819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 320/636] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:58.549803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c423b-8de7-4217-bb1a-9f89b5aedeb6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:58.582748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab838485-dca1-4991-aff1-c079add55821 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:58.596812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:58.617975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8b7cc-5ca1-41d1-bb30-84d895b83d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:58.618776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8b7cc-5ca1-41d1-bb30-84d895b83d8e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.619199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8b7cc-5ca1-41d1-bb30-84d895b83d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.619474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8b7cc-5ca1-41d1-bb30-84d895b83d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.632205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8b7cc-5ca1-41d1-bb30-84d895b83d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:58.633758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8b7cc-5ca1-41d1-bb30-84d895b83d8e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e7e8b7cc-5ca1-41d1-bb30-84d895b83d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:58.651534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:58.652414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:58.653378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:58.653378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:58.653378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:58.653378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:58.653378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 317/637] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:58.654279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600ce77-ca37-4cc0-8003-e1337a3ed1aa None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.654279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600ce77-ca37-4cc0-8003-e1337a3ed1aa None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.654586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600ce77-ca37-4cc0-8003-e1337a3ed1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.665088 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:58.669679 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c423b-8de7-4217-bb1a-9f89b5aedeb6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:58.671956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2600ce77-ca37-4cc0-8003-e1337a3ed1aa None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:17:58.673169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2600ce77-ca37-4cc0-8003-e1337a3ed1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:17:58.706683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91a73-7c6b-4f99-a175-dd77efcc1b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:58.707485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91a73-7c6b-4f99-a175-dd77efcc1b64 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.707763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91a73-7c6b-4f99-a175-dd77efcc1b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.708034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef91a73-7c6b-4f99-a175-dd77efcc1b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.718660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef91a73-7c6b-4f99-a175-dd77efcc1b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:58.720116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef91a73-7c6b-4f99-a175-dd77efcc1b64 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2ef91a73-7c6b-4f99-a175-dd77efcc1b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:58.738387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:58.739351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:58.740250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:58.740250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:58.740250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:58.740250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:58.740250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 321/638] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:58.740823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91a73-7c6b-4f99-a175-dd77efcc1b64 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:58.758840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 318/639] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:17:58.760401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600ce77-ca37-4cc0-8003-e1337a3ed1aa None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:58.844436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:58.858063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef91a73-7c6b-4f99-a175-dd77efcc1b64 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:58.876881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600ce77-ca37-4cc0-8003-e1337a3ed1aa None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:58.891791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e3449-4042-4201-bf2e-05a8b984c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:58.892594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3449-4042-4201-bf2e-05a8b984c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.892898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3449-4042-4201-bf2e-05a8b984c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.893166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e3449-4042-4201-bf2e-05a8b984c5a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.903369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e3449-4042-4201-bf2e-05a8b984c5a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a55e3449-4042-4201-bf2e-05a8b984c5a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:58.911163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:58.912109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:58.912962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 322/640] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:58.914286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e3449-4042-4201-bf2e-05a8b984c5a5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:58.918460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfbc2c-5d2a-4dd4-873d-3a753032b34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:58.919161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfbc2c-5d2a-4dd4-873d-3a753032b34c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:58.919481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfbc2c-5d2a-4dd4-873d-3a753032b34c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:58.919828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfbc2c-5d2a-4dd4-873d-3a753032b34c None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:58.920560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfbc2c-5d2a-4dd4-873d-3a753032b34c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:58.920864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfbc2c-5d2a-4dd4-873d-3a753032b34c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:58.922271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfbc2c-5d2a-4dd4-873d-3a753032b34c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:58.925034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:58.935692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 319/641] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:58.936499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfbc2c-5d2a-4dd4-873d-3a753032b34c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.023383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e3449-4042-4201-bf2e-05a8b984c5a5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.042393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfbc2c-5d2a-4dd4-873d-3a753032b34c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.059036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705b75-8f56-4922-8bab-8b64645ed9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.059782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705b75-8f56-4922-8bab-8b64645ed9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.060071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705b75-8f56-4922-8bab-8b64645ed9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.060403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab705b75-8f56-4922-8bab-8b64645ed9c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.061162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab705b75-8f56-4922-8bab-8b64645ed9c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:59.061471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab705b75-8f56-4922-8bab-8b64645ed9c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.063001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab705b75-8f56-4922-8bab-8b64645ed9c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.075527 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bfcdb-4eb2-4d85-adfe-611cc72d7c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.080584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 323/642] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:59.080727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bfcdb-4eb2-4d85-adfe-611cc72d7c1f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.080727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bfcdb-4eb2-4d85-adfe-611cc72d7c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.080910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705b75-8f56-4922-8bab-8b64645ed9c1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.080985 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bfcdb-4eb2-4d85-adfe-611cc72d7c1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.090899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:59.091376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bfcdb-4eb2-4d85-adfe-611cc72d7c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-262bfcdb-4eb2-4d85-adfe-611cc72d7c1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:17:59.099150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:59.100177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:59.101075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 320/643] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:17:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:59.101800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bfcdb-4eb2-4d85-adfe-611cc72d7c1f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.168414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:59.192147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab705b75-8f56-4922-8bab-8b64645ed9c1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.214578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bfcdb-4eb2-4d85-adfe-611cc72d7c1f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.230809 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d009b4-fe9e-482e-b91a-5271924083cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.232079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d009b4-fe9e-482e-b91a-5271924083cb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.232363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d009b4-fe9e-482e-b91a-5271924083cb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.232891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d009b4-fe9e-482e-b91a-5271924083cb None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.234014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d009b4-fe9e-482e-b91a-5271924083cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:59.234322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d009b4-fe9e-482e-b91a-5271924083cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.235703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d009b4-fe9e-482e-b91a-5271924083cb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.247303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 324/644] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:59.248332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d009b4-fe9e-482e-b91a-5271924083cb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.253050 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fc64c-78f4-49fa-a534-8ddf54ab473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.253838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fc64c-78f4-49fa-a534-8ddf54ab473e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.254118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fc64c-78f4-49fa-a534-8ddf54ab473e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.254396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fc64c-78f4-49fa-a534-8ddf54ab473e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.262593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fc64c-78f4-49fa-a534-8ddf54ab473e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.264119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fc64c-78f4-49fa-a534-8ddf54ab473e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4b4fc64c-78f4-49fa-a534-8ddf54ab473e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:17:59.279044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:59.280028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 321/645] 10.222.0.59 () {56 vars in 1093 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:59.281202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fc64c-78f4-49fa-a534-8ddf54ab473e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.327793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:59.363673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d009b4-fe9e-482e-b91a-5271924083cb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.387261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fc64c-78f4-49fa-a534-8ddf54ab473e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.399997 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857753da-cdc3-4115-bc36-eaf97640b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.400793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857753da-cdc3-4115-bc36-eaf97640b37c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.401095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857753da-cdc3-4115-bc36-eaf97640b37c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.401375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857753da-cdc3-4115-bc36-eaf97640b37c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.404282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:59.408219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857753da-cdc3-4115-bc36-eaf97640b37c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.409706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857753da-cdc3-4115-bc36-eaf97640b37c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.423082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e5e59-2931-4aff-b2ce-13b7ae10d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.423743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5e59-2931-4aff-b2ce-13b7ae10d885 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-857753da-cdc3-4115-bc36-eaf97640b37c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:17:59.423916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:59.424784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:59.425962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:17:59.425962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:17:59.425962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:17:59.425962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:17:59.425962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:17:59.425962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:17:59.425962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:17:59.425962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:59.426389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5e59-2931-4aff-b2ce-13b7ae10d885 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.426389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5e59-2931-4aff-b2ce-13b7ae10d885 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.426389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e5e59-2931-4aff-b2ce-13b7ae10d885 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:59.426389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e5e59-2931-4aff-b2ce-13b7ae10d885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.426945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e5e59-2931-4aff-b2ce-13b7ae10d885 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.429831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 325/646] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:59.430540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857753da-cdc3-4115-bc36-eaf97640b37c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.440496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 322/647] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:59.440496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e5e59-2931-4aff-b2ce-13b7ae10d885 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.538079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857753da-cdc3-4115-bc36-eaf97640b37c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.546017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e5e59-2931-4aff-b2ce-13b7ae10d885 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.572394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:59.579699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dc0a6-78d6-43d0-be58-c6d45cf924c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.579866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275af5-4ba8-43f2-8efb-261c2e548ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.580476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275af5-4ba8-43f2-8efb-261c2e548ced None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.580579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dc0a6-78d6-43d0-be58-c6d45cf924c2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.580743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275af5-4ba8-43f2-8efb-261c2e548ced None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.580837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dc0a6-78d6-43d0-be58-c6d45cf924c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.581042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275af5-4ba8-43f2-8efb-261c2e548ced None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.581134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dc0a6-78d6-43d0-be58-c6d45cf924c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.581894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275af5-4ba8-43f2-8efb-261c2e548ced None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:59.582205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275af5-4ba8-43f2-8efb-261c2e548ced None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.583667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28275af5-4ba8-43f2-8efb-261c2e548ced None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.594569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dc0a6-78d6-43d0-be58-c6d45cf924c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.596074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dc0a6-78d6-43d0-be58-c6d45cf924c2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.608121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 323/648] 10.222.0.59 () {56 vars in 1133 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:59.608121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275af5-4ba8-43f2-8efb-261c2e548ced None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f77dc0a6-78d6-43d0-be58-c6d45cf924c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:59.621065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:59.621960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:59.622850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:59.622850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:59.622850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:59.622850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:59.622850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 326/649] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:59.623706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dc0a6-78d6-43d0-be58-c6d45cf924c2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.644280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:59.713097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275af5-4ba8-43f2-8efb-261c2e548ced None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.728281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dc0a6-78d6-43d0-be58-c6d45cf924c2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.755079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bda18-962b-4d3a-baa0-d8e7c038f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.755760 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bda18-962b-4d3a-baa0-d8e7c038f656 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.756042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bda18-962b-4d3a-baa0-d8e7c038f656 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.756317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bda18-962b-4d3a-baa0-d8e7c038f656 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.757149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bda18-962b-4d3a-baa0-d8e7c038f656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:59.757472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bda18-962b-4d3a-baa0-d8e7c038f656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.758911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bda18-962b-4d3a-baa0-d8e7c038f656 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.769453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b380d1e-f7c5-4cb6-a843-83db431fb808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.770370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b380d1e-f7c5-4cb6-a843-83db431fb808 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.770711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b380d1e-f7c5-4cb6-a843-83db431fb808 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.776012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b380d1e-f7c5-4cb6-a843-83db431fb808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.776153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 324/650] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:59.776153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bda18-962b-4d3a-baa0-d8e7c038f656 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.786735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b380d1e-f7c5-4cb6-a843-83db431fb808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.788355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b380d1e-f7c5-4cb6-a843-83db431fb808 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6b380d1e-f7c5-4cb6-a843-83db431fb808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:17:59.807117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:17:59.808002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:17:59.808923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:17:59.808923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:17:59.808923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:17:59.808923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:17:59.808923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 327/651] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:17:59.809203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b380d1e-f7c5-4cb6-a843-83db431fb808 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.848988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:59.881222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:17:59.888161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bda18-962b-4d3a-baa0-d8e7c038f656 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.924404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb8aa0-d42e-44a4-8bb5-55811d8bcb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.925089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8aa0-d42e-44a4-8bb5-55811d8bcb34 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.925291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b380d1e-f7c5-4cb6-a843-83db431fb808 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:17:59.925408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8aa0-d42e-44a4-8bb5-55811d8bcb34 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.925636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8aa0-d42e-44a4-8bb5-55811d8bcb34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.963507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c7628-1c7c-4428-83a0-9a13c03a1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:17:59.964182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c7628-1c7c-4428-83a0-9a13c03a1b2b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:17:59.964882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c7628-1c7c-4428-83a0-9a13c03a1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:17:59.965162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c7628-1c7c-4428-83a0-9a13c03a1b2b None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:17:59.966014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c7628-1c7c-4428-83a0-9a13c03a1b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:17:59.966738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c7628-1c7c-4428-83a0-9a13c03a1b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:17:59.968435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c7628-1c7c-4428-83a0-9a13c03a1b2b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:17:59.985230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 328/652] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:17:59.985230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c7628-1c7c-4428-83a0-9a13c03a1b2b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:17:59.998532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb8aa0-d42e-44a4-8bb5-55811d8bcb34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:00.000134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb8aa0-d42e-44a4-8bb5-55811d8bcb34 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:00.083573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:00.090696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c7628-1c7c-4428-83a0-9a13c03a1b2b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:00.096483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:00.103402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 325/653] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:18:00.104213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb8aa0-d42e-44a4-8bb5-55811d8bcb34 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.123721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febd44d-cbaa-45c8-aea2-fcca6500074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:00.124373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febd44d-cbaa-45c8-aea2-fcca6500074c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.124648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febd44d-cbaa-45c8-aea2-fcca6500074c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.124943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febd44d-cbaa-45c8-aea2-fcca6500074c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.125763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febd44d-cbaa-45c8-aea2-fcca6500074c None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=87a4ed0881004eef94166ace450b8a63) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:00.126072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febd44d-cbaa-45c8-aea2-fcca6500074c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:00.127505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febd44d-cbaa-45c8-aea2-fcca6500074c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:00.133462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 329/654] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:17:59 2022] GET /identity/v3/role_assignments?user.id=87a4ed0881004eef94166ace450b8a63&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:00.134301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febd44d-cbaa-45c8-aea2-fcca6500074c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.223177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb8aa0-d42e-44a4-8bb5-55811d8bcb34 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:00.257191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febd44d-cbaa-45c8-aea2-fcca6500074c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:00.262227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79401e-fe93-4276-948c-5a56fb6494ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:00.262931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79401e-fe93-4276-948c-5a56fb6494ea None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.263238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79401e-fe93-4276-948c-5a56fb6494ea None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.263542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79401e-fe93-4276-948c-5a56fb6494ea None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.264418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79401e-fe93-4276-948c-5a56fb6494ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:00.264979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79401e-fe93-4276-948c-5a56fb6494ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:00.267114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79401e-fe93-4276-948c-5a56fb6494ea None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:00.284879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 326/655] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:00.284879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95b83-9712-4291-8c65-47115225e708 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.284879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95b83-9712-4291-8c65-47115225e708 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.284879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e95b83-9712-4291-8c65-47115225e708 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.284879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 327/656] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:00.284879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95b83-9712-4291-8c65-47115225e708 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.302642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be738d-53a8-487a-b243-955a675dc504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:00.303462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be738d-53a8-487a-b243-955a675dc504 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.303742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be738d-53a8-487a-b243-955a675dc504 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.304651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be738d-53a8-487a-b243-955a675dc504 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.314702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be738d-53a8-487a-b243-955a675dc504 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:00.316177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be738d-53a8-487a-b243-955a675dc504 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-05be738d-53a8-487a-b243-955a675dc504 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:00.331187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:00.332563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 330/657] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:00.333538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be738d-53a8-487a-b243-955a675dc504 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.352375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:00.356079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:00.404962 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e95b83-9712-4291-8c65-47115225e708 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:00.441600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788f9b1-4de2-42db-ac50-838a7000fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:00.442368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788f9b1-4de2-42db-ac50-838a7000fe6d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.442656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788f9b1-4de2-42db-ac50-838a7000fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.442961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788f9b1-4de2-42db-ac50-838a7000fe6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.446661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be738d-53a8-487a-b243-955a675dc504 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:00.454092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788f9b1-4de2-42db-ac50-838a7000fe6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:00.455574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788f9b1-4de2-42db-ac50-838a7000fe6d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c788f9b1-4de2-42db-ac50-838a7000fe6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:00.472969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:00.473901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:00.474802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:00.474802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:00.474802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:00.474802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:00.474802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 328/658] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:00.475505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccd577-5fc1-4cbf-a904-585ecfec8b2c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.475666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccd577-5fc1-4cbf-a904-585ecfec8b2c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.475931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccd577-5fc1-4cbf-a904-585ecfec8b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.486593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1c58e-58d8-459a-bfd3-044673135e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:00.487403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1c58e-58d8-459a-bfd3-044673135e11 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.487687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1c58e-58d8-459a-bfd3-044673135e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.487962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1c58e-58d8-459a-bfd3-044673135e11 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.494988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b0ccd577-5fc1-4cbf-a904-585ecfec8b2c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:00.495905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1c58e-58d8-459a-bfd3-044673135e11 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:00.496185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b0ccd577-5fc1-4cbf-a904-585ecfec8b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:00.497409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1c58e-58d8-459a-bfd3-044673135e11 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-88a1c58e-58d8-459a-bfd3-044673135e11 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:00.513192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:00.514248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:00.515194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 331/659] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:00.515795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1c58e-58d8-459a-bfd3-044673135e11 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.569790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 329/660] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:18:00.573774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccd577-5fc1-4cbf-a904-585ecfec8b2c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.610637 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:00.618953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:00.635644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1c58e-58d8-459a-bfd3-044673135e11 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:00.674521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58247f-368a-472d-96e9-45dba7033f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:00.675204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58247f-368a-472d-96e9-45dba7033f51 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.675482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58247f-368a-472d-96e9-45dba7033f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.675926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58247f-368a-472d-96e9-45dba7033f51 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.676603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58247f-368a-472d-96e9-45dba7033f51 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:00.676908 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58247f-368a-472d-96e9-45dba7033f51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:00.678361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58247f-368a-472d-96e9-45dba7033f51 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:00.684955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccd577-5fc1-4cbf-a904-585ecfec8b2c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:00.701085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 332/661] 10.222.0.59 () {56 vars in 1137 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:00.701935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58247f-368a-472d-96e9-45dba7033f51 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.725861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849ea2-2953-489c-8b9a-a176e46d12da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:00.727183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849ea2-2953-489c-8b9a-a176e46d12da None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.728071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849ea2-2953-489c-8b9a-a176e46d12da None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.728816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1849ea2-2953-489c-8b9a-a176e46d12da None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.729975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1849ea2-2953-489c-8b9a-a176e46d12da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:00.730461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1849ea2-2953-489c-8b9a-a176e46d12da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:00.732396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1849ea2-2953-489c-8b9a-a176e46d12da None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:00.751062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 330/662] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:00.752174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849ea2-2953-489c-8b9a-a176e46d12da None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.811064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58247f-368a-472d-96e9-45dba7033f51 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:00.847753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28529765-8010-4d7b-81ef-aac29eb64c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:00.848443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28529765-8010-4d7b-81ef-aac29eb64c9d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.848775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28529765-8010-4d7b-81ef-aac29eb64c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.849089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28529765-8010-4d7b-81ef-aac29eb64c9d None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.849928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28529765-8010-4d7b-81ef-aac29eb64c9d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:00.850240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28529765-8010-4d7b-81ef-aac29eb64c9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:00.851834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28529765-8010-4d7b-81ef-aac29eb64c9d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:00.852334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:00.854673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:00.857087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1849ea2-2953-489c-8b9a-a176e46d12da None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:00.870774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 333/663] 10.222.0.59 () {56 vars in 1139 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:00.871542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28529765-8010-4d7b-81ef-aac29eb64c9d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.899538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3f0e-e74d-4dde-8003-948a5af9ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:00.900338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3f0e-e74d-4dde-8003-948a5af9ef58 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:00.900642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3f0e-e74d-4dde-8003-948a5af9ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:00.900908 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3f0e-e74d-4dde-8003-948a5af9ef58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:00.911234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb3f0e-e74d-4dde-8003-948a5af9ef58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-28bb3f0e-e74d-4dde-8003-948a5af9ef58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:00.918864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:00.919868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:00.920708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 331/664] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:00.921453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3f0e-e74d-4dde-8003-948a5af9ef58 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:00.980814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28529765-8010-4d7b-81ef-aac29eb64c9d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.021034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca22a3-f1c3-49af-a37b-d5477b4a43a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.022573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca22a3-f1c3-49af-a37b-d5477b4a43a2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.023083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca22a3-f1c3-49af-a37b-d5477b4a43a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.023538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca22a3-f1c3-49af-a37b-d5477b4a43a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.024186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3f0e-e74d-4dde-8003-948a5af9ef58 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.059719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165bbc0-01ed-419d-88a6-e0a99a6e40b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.060522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165bbc0-01ed-419d-88a6-e0a99a6e40b9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.060799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165bbc0-01ed-419d-88a6-e0a99a6e40b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.061103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165bbc0-01ed-419d-88a6-e0a99a6e40b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.068007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165bbc0-01ed-419d-88a6-e0a99a6e40b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.069547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165bbc0-01ed-419d-88a6-e0a99a6e40b9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e165bbc0-01ed-419d-88a6-e0a99a6e40b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:01.083709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:01.084581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:01.085502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:01.085502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:01.085502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:01.085502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:01.085502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:01.085502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:01.085502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:01.085502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:01.085502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 332/665] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:01.086513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165bbc0-01ed-419d-88a6-e0a99a6e40b9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:01.098178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:01.104672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:01.107795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca22a3-f1c3-49af-a37b-d5477b4a43a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.109315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca22a3-f1c3-49af-a37b-d5477b4a43a2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.189477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165bbc0-01ed-419d-88a6-e0a99a6e40b9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.216455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 334/666] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:18:01.221789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca22a3-f1c3-49af-a37b-d5477b4a43a2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:01.224814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544786af-22a2-4266-8fab-21cb185d8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.225936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544786af-22a2-4266-8fab-21cb185d8320 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.226443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544786af-22a2-4266-8fab-21cb185d8320 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.226938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544786af-22a2-4266-8fab-21cb185d8320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.316097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544786af-22a2-4266-8fab-21cb185d8320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.317702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544786af-22a2-4266-8fab-21cb185d8320 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.322110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:01.329963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca22a3-f1c3-49af-a37b-d5477b4a43a2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.337882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:01.364998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b919f-cb98-4d85-9eaa-19ac2d0f00d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.366252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b919f-cb98-4d85-9eaa-19ac2d0f00d8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.366533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b919f-cb98-4d85-9eaa-19ac2d0f00d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.366805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b919f-cb98-4d85-9eaa-19ac2d0f00d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.367552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b919f-cb98-4d85-9eaa-19ac2d0f00d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:01.367854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b919f-cb98-4d85-9eaa-19ac2d0f00d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.369291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b919f-cb98-4d85-9eaa-19ac2d0f00d8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.381870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 335/667] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:01.381870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b919f-cb98-4d85-9eaa-19ac2d0f00d8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:01.434824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 333/668] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:18:01.434824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544786af-22a2-4266-8fab-21cb185d8320 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:01.488587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b919f-cb98-4d85-9eaa-19ac2d0f00d8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.521684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c4b2-52a3-4d3e-89e9-7b9fca194f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.522342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c4b2-52a3-4d3e-89e9-7b9fca194f43 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.522628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c4b2-52a3-4d3e-89e9-7b9fca194f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.522888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0c4b2-52a3-4d3e-89e9-7b9fca194f43 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.523670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0c4b2-52a3-4d3e-89e9-7b9fca194f43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:01.523972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0c4b2-52a3-4d3e-89e9-7b9fca194f43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.525440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca0c4b2-52a3-4d3e-89e9-7b9fca194f43 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.533460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544786af-22a2-4266-8fab-21cb185d8320 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.538211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 336/669] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:01.539156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c4b2-52a3-4d3e-89e9-7b9fca194f43 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:01.552282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:01.561120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:01.570663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c4e02-3682-4a0d-a604-b633bea6c468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.571453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c4e02-3682-4a0d-a604-b633bea6c468 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.571723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c4e02-3682-4a0d-a604-b633bea6c468 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.571992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c4e02-3682-4a0d-a604-b633bea6c468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.581822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c4e02-3682-4a0d-a604-b633bea6c468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.583254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c4e02-3682-4a0d-a604-b633bea6c468 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c48c4e02-3682-4a0d-a604-b633bea6c468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:01.600713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:01.601655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:01.602551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:01.602551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:01.602551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:01.602551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:01.602551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 334/670] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:01.602832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c4e02-3682-4a0d-a604-b633bea6c468 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:01.652556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0c4b2-52a3-4d3e-89e9-7b9fca194f43 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.691796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48652f-02f1-4d6b-bedc-430edd9a875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.692908 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48652f-02f1-4d6b-bedc-430edd9a875c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.693365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48652f-02f1-4d6b-bedc-430edd9a875c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.693807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48652f-02f1-4d6b-bedc-430edd9a875c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.704343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48652f-02f1-4d6b-bedc-430edd9a875c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.705750 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c4e02-3682-4a0d-a604-b633bea6c468 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.706264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48652f-02f1-4d6b-bedc-430edd9a875c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-aa48652f-02f1-4d6b-bedc-430edd9a875c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:01.724595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:01.725654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:01.726731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:01.726731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:01.726731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:01.726731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:01.728574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 337/671] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:01.729598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48652f-02f1-4d6b-bedc-430edd9a875c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:01.757425 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201e61-43b5-4a19-9f53-f54def717734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.758237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201e61-43b5-4a19-9f53-f54def717734 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.758517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201e61-43b5-4a19-9f53-f54def717734 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.758790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7201e61-43b5-4a19-9f53-f54def717734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.769868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7201e61-43b5-4a19-9f53-f54def717734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.771466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7201e61-43b5-4a19-9f53-f54def717734 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-d7201e61-43b5-4a19-9f53-f54def717734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:01.789589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:01.790883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:01.792078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:01.792078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:01.792078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:01.792078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:01.795534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 335/672] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:01.796391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201e61-43b5-4a19-9f53-f54def717734 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:01.816670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:01.821091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:01.858925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48652f-02f1-4d6b-bedc-430edd9a875c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.896196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47870c5-5dda-486b-989a-65e45f37e201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.897150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47870c5-5dda-486b-989a-65e45f37e201 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.897281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7201e61-43b5-4a19-9f53-f54def717734 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:01.897697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47870c5-5dda-486b-989a-65e45f37e201 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.898137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47870c5-5dda-486b-989a-65e45f37e201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.899340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47870c5-5dda-486b-989a-65e45f37e201 None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=efdfb91ba4c04452ba547baa184185c4) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:01.899658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47870c5-5dda-486b-989a-65e45f37e201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.901140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47870c5-5dda-486b-989a-65e45f37e201 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.916878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 338/673] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/role_assignments?user.id=efdfb91ba4c04452ba547baa184185c4&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:01.916878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47870c5-5dda-486b-989a-65e45f37e201 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:01.947706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa582-3c75-4cfd-84ad-2f423d909434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:01.948647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa582-3c75-4cfd-84ad-2f423d909434 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:01.949026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa582-3c75-4cfd-84ad-2f423d909434 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:01.949630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96faa582-3c75-4cfd-84ad-2f423d909434 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:01.950675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa582-3c75-4cfd-84ad-2f423d909434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:01.951089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa582-3c75-4cfd-84ad-2f423d909434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:01.952739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96faa582-3c75-4cfd-84ad-2f423d909434 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:01.968753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 336/674] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:01.969792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa582-3c75-4cfd-84ad-2f423d909434 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.037123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47870c5-5dda-486b-989a-65e45f37e201 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.078965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:02.089637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:02.092014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c65d54-0917-4ff4-920c-beddc0a1248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:02.092935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c65d54-0917-4ff4-920c-beddc0a1248f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.093386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c65d54-0917-4ff4-920c-beddc0a1248f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.093654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c65d54-0917-4ff4-920c-beddc0a1248f None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.094390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c65d54-0917-4ff4-920c-beddc0a1248f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:02.094693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c65d54-0917-4ff4-920c-beddc0a1248f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:02.096078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c65d54-0917-4ff4-920c-beddc0a1248f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:02.109905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 339/675] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:02.110607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c65d54-0917-4ff4-920c-beddc0a1248f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.119637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96faa582-3c75-4cfd-84ad-2f423d909434 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.157221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630151-115b-4caa-b0bd-40ef4038b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:02.158315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630151-115b-4caa-b0bd-40ef4038b9bb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.158599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630151-115b-4caa-b0bd-40ef4038b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.158874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630151-115b-4caa-b0bd-40ef4038b9bb None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.159948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59630151-115b-4caa-b0bd-40ef4038b9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:02.160264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59630151-115b-4caa-b0bd-40ef4038b9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:02.161989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59630151-115b-4caa-b0bd-40ef4038b9bb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:02.176820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 337/676] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:02.177702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630151-115b-4caa-b0bd-40ef4038b9bb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.232729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c65d54-0917-4ff4-920c-beddc0a1248f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.271016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebe6ca-0fca-45b1-9fe5-7dd602c36b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:02.271828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebe6ca-0fca-45b1-9fe5-7dd602c36b84 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.272105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebe6ca-0fca-45b1-9fe5-7dd602c36b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.272373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebe6ca-0fca-45b1-9fe5-7dd602c36b84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.279630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebe6ca-0fca-45b1-9fe5-7dd602c36b84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:02.281254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebe6ca-0fca-45b1-9fe5-7dd602c36b84 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:02.292461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630151-115b-4caa-b0bd-40ef4038b9bb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-44ebe6ca-0fca-45b1-9fe5-7dd602c36b84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:02.300217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:02.301144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:02.302033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:02.302033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:02.302033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:02.302033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:02.302033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:02.302033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:02.302033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:02.302033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:02.303213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 340/677] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:02.304077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebe6ca-0fca-45b1-9fe5-7dd602c36b84 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.332036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1eca5b-b9c7-425b-a8cc-5535b315718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:02.333237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eca5b-b9c7-425b-a8cc-5535b315718d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.333521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eca5b-b9c7-425b-a8cc-5535b315718d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.333796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1eca5b-b9c7-425b-a8cc-5535b315718d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.341813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eca5b-b9c7-425b-a8cc-5535b315718d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:02.343276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1eca5b-b9c7-425b-a8cc-5535b315718d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ce1eca5b-b9c7-425b-a8cc-5535b315718d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:02.358433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:02.359433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:02.360396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 338/678] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:02.361068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7131-1f0b-40d8-8b03-d50071e55382 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.362062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7131-1f0b-40d8-8b03-d50071e55382 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.362062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee7131-1f0b-40d8-8b03-d50071e55382 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.362632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:02.367165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 339/679] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:02.367165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7131-1f0b-40d8-8b03-d50071e55382 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.368049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:02.416227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebe6ca-0fca-45b1-9fe5-7dd602c36b84 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.451703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff6a43-e900-4491-bc09-3b940087b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:02.452548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff6a43-e900-4491-bc09-3b940087b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.452832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff6a43-e900-4491-bc09-3b940087b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.453137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff6a43-e900-4491-bc09-3b940087b7f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.463598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff6a43-e900-4491-bc09-3b940087b7f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:02.465154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff6a43-e900-4491-bc09-3b940087b7f2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-aaff6a43-e900-4491-bc09-3b940087b7f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:02.479250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:02.480195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 341/680] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:02.481842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff6a43-e900-4491-bc09-3b940087b7f2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.489968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee7131-1f0b-40d8-8b03-d50071e55382 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.531791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375c1ab8-7142-4492-9749-8409f1ea7acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:02.532517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c1ab8-7142-4492-9749-8409f1ea7acc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.532785 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c1ab8-7142-4492-9749-8409f1ea7acc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.533088 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375c1ab8-7142-4492-9749-8409f1ea7acc None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.533877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c1ab8-7142-4492-9749-8409f1ea7acc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:02.534428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c1ab8-7142-4492-9749-8409f1ea7acc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:02.535652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375c1ab8-7142-4492-9749-8409f1ea7acc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:02.550952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 340/681] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:02.552291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3dfce-2871-4076-a0b9-add5236f5a6a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.552582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3dfce-2871-4076-a0b9-add5236f5a6a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.552874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3dfce-2871-4076-a0b9-add5236f5a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.569925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9fb3dfce-2871-4076-a0b9-add5236f5a6a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:02.571153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9fb3dfce-2871-4076-a0b9-add5236f5a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:02.593700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff6a43-e900-4491-bc09-3b940087b7f2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.606781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:02.633248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:02.637088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4719e-4d8e-4565-a1b1-d3c826780b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:02.637664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4719e-4d8e-4565-a1b1-d3c826780b4b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.637951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4719e-4d8e-4565-a1b1-d3c826780b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.638272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4719e-4d8e-4565-a1b1-d3c826780b4b None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.639112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4719e-4d8e-4565-a1b1-d3c826780b4b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:02.639415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4719e-4d8e-4565-a1b1-d3c826780b4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:02.640907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4719e-4d8e-4565-a1b1-d3c826780b4b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:02.645551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 341/682] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:18:02.645939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3dfce-2871-4076-a0b9-add5236f5a6a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.678694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 342/683] 10.222.0.59 () {56 vars in 1135 bytes} [Fri Jul 1 16:18:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:02.680049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4719e-4d8e-4565-a1b1-d3c826780b4b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.761195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3dfce-2871-4076-a0b9-add5236f5a6a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.794091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4719e-4d8e-4565-a1b1-d3c826780b4b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.797469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806212d-ae56-4b27-87ac-9fc843dcd341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:02.798141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806212d-ae56-4b27-87ac-9fc843dcd341 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.798423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806212d-ae56-4b27-87ac-9fc843dcd341 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.798699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806212d-ae56-4b27-87ac-9fc843dcd341 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.799489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806212d-ae56-4b27-87ac-9fc843dcd341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:02.799799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806212d-ae56-4b27-87ac-9fc843dcd341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:02.801337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806212d-ae56-4b27-87ac-9fc843dcd341 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:02.819494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 342/684] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:02.819494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806212d-ae56-4b27-87ac-9fc843dcd341 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.831032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c516bc0-fac0-4732-9767-f467de205d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:02.831845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c516bc0-fac0-4732-9767-f467de205d13 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:02.832432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c516bc0-fac0-4732-9767-f467de205d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:02.832851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c516bc0-fac0-4732-9767-f467de205d13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:02.833844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c516bc0-fac0-4732-9767-f467de205d13 None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=c4980d7e51e84655add2a53808818598) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:02.834167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c516bc0-fac0-4732-9767-f467de205d13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:02.836167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c516bc0-fac0-4732-9767-f467de205d13 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:02.844161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 343/685] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:02 2022] GET /identity/v3/role_assignments?user.id=c4980d7e51e84655add2a53808818598&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:02.845259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c516bc0-fac0-4732-9767-f467de205d13 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:02.892134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:02.896269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:02.956335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806212d-ae56-4b27-87ac-9fc843dcd341 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:02.973675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c516bc0-fac0-4732-9767-f467de205d13 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:03.006376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9c8bf-95e6-4b6a-879b-bf54dc6ca65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:03.007213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9c8bf-95e6-4b6a-879b-bf54dc6ca65c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:03.007497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9c8bf-95e6-4b6a-879b-bf54dc6ca65c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:03.007774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9c8bf-95e6-4b6a-879b-bf54dc6ca65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:03.014441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f26b2-d812-458c-a763-b14c7b77c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:03.015525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f26b2-d812-458c-a763-b14c7b77c264 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:03.016009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f26b2-d812-458c-a763-b14c7b77c264 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:03.016482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f26b2-d812-458c-a763-b14c7b77c264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:03.023052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9c8bf-95e6-4b6a-879b-bf54dc6ca65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:03.024545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9c8bf-95e6-4b6a-879b-bf54dc6ca65c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-27a9c8bf-95e6-4b6a-879b-bf54dc6ca65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:03.043629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:03.044663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:03.045650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:03.045650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:03.045650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:03.045650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:03.045650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 343/686] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:03.045943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9c8bf-95e6-4b6a-879b-bf54dc6ca65c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:03.100180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f26b2-d812-458c-a763-b14c7b77c264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:03.101704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f26b2-d812-458c-a763-b14c7b77c264 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:03.169438 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9c8bf-95e6-4b6a-879b-bf54dc6ca65c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:03.173752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:03.177264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:03.213419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788d873-6dfe-485e-8629-225eb26fdf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:03.214839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788d873-6dfe-485e-8629-225eb26fdf50 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:03.215285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788d873-6dfe-485e-8629-225eb26fdf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:03.215716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788d873-6dfe-485e-8629-225eb26fdf50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:03.217044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788d873-6dfe-485e-8629-225eb26fdf50 None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=11785acde2f74ad481d1224f2a7fd296) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:03.217639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788d873-6dfe-485e-8629-225eb26fdf50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:03.219878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788d873-6dfe-485e-8629-225eb26fdf50 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:03.228253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 344/687] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:03 2022] GET /identity/v3/role_assignments?user.id=11785acde2f74ad481d1224f2a7fd296&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:03.229367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788d873-6dfe-485e-8629-225eb26fdf50 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:03.233483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 344/688] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:18:03.240212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f26b2-d812-458c-a763-b14c7b77c264 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:03.373953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f26b2-d812-458c-a763-b14c7b77c264 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:03.421693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd07d11-46aa-4377-abe9-528d8311dd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:03.422508 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07d11-46aa-4377-abe9-528d8311dd8d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:03.422788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07d11-46aa-4377-abe9-528d8311dd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:03.423058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd07d11-46aa-4377-abe9-528d8311dd8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:03.425525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:03.439144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd07d11-46aa-4377-abe9-528d8311dd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:03.440955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd07d11-46aa-4377-abe9-528d8311dd8d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:03.450930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788d873-6dfe-485e-8629-225eb26fdf50 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-edd07d11-46aa-4377-abe9-528d8311dd8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:03.468606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:03.469573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:03.470460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:03.470460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:03.470460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:03.470460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:03.470460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 345/689] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:03.475940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd07d11-46aa-4377-abe9-528d8311dd8d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:03.490286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4577d-e73d-40d9-a083-974fc9070f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:03.491060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4577d-e73d-40d9-a083-974fc9070f41 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:03.491343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4577d-e73d-40d9-a083-974fc9070f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:03.491623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4577d-e73d-40d9-a083-974fc9070f41 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:03.492497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4577d-e73d-40d9-a083-974fc9070f41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:03.492806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4577d-e73d-40d9-a083-974fc9070f41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:03.494225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4577d-e73d-40d9-a083-974fc9070f41 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:03.509168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 345/690] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:03.514753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4577d-e73d-40d9-a083-974fc9070f41 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:03.544330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:03.597731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd07d11-46aa-4377-abe9-528d8311dd8d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:03.637629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba1bab-85bd-480c-b4d0-93b1bd4ba73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:03.638379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba1bab-85bd-480c-b4d0-93b1bd4ba73e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:03.638658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba1bab-85bd-480c-b4d0-93b1bd4ba73e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:03.638930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba1bab-85bd-480c-b4d0-93b1bd4ba73e None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:03.639663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba1bab-85bd-480c-b4d0-93b1bd4ba73e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:03.640021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba1bab-85bd-480c-b4d0-93b1bd4ba73e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:03.641474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba1bab-85bd-480c-b4d0-93b1bd4ba73e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:03.654711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 346/691] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:03.657316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4577d-e73d-40d9-a083-974fc9070f41 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:03.661877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba1bab-85bd-480c-b4d0-93b1bd4ba73e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:03.718816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:03.766807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eabed9-4336-4390-9960-d2eedf324fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:03.767497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eabed9-4336-4390-9960-d2eedf324fba None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:03.767778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eabed9-4336-4390-9960-d2eedf324fba None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:03.768052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eabed9-4336-4390-9960-d2eedf324fba None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:03.768769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eabed9-4336-4390-9960-d2eedf324fba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:03.770261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eabed9-4336-4390-9960-d2eedf324fba None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:03.773100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba1bab-85bd-480c-b4d0-93b1bd4ba73e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:03.812880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 346/692] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:18:03 2022] POST /identity/v3/users => generated 254 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:03.829513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184bafc-1cdc-4262-bed7-6b304841abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:03.830740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184bafc-1cdc-4262-bed7-6b304841abab None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:03.831211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184bafc-1cdc-4262-bed7-6b304841abab None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:03.831703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184bafc-1cdc-4262-bed7-6b304841abab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:03.845118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184bafc-1cdc-4262-bed7-6b304841abab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:03.846907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184bafc-1cdc-4262-bed7-6b304841abab None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2184bafc-1cdc-4262-bed7-6b304841abab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:03.869531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:03.870493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:03.871398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:03.871398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:03.871398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:03.871398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:03.871398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:03.871398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:03.871398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:03.871398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:03.881414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 347/693] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:03.882551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eabed9-4336-4390-9960-d2eedf324fba None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:04.023191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:04.043975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eabed9-4336-4390-9960-d2eedf324fba None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:04.081292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71217e7-be78-451d-9707-05ad47042f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:04.081964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71217e7-be78-451d-9707-05ad47042f9f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:04.082243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71217e7-be78-451d-9707-05ad47042f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:04.082516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71217e7-be78-451d-9707-05ad47042f9f None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:04.083302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71217e7-be78-451d-9707-05ad47042f9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:04.083606 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71217e7-be78-451d-9707-05ad47042f9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:04.085077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71217e7-be78-451d-9707-05ad47042f9f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:04.097923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 347/694] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:04.103750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184bafc-1cdc-4262-bed7-6b304841abab None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:04.234280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dfbca-b80f-4cc4-b81e-be58789438a2 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:04.234879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dfbca-b80f-4cc4-b81e-be58789438a2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:04.235347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dfbca-b80f-4cc4-b81e-be58789438a2 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:04.236933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 348/695] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:18:04.238972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184bafc-1cdc-4262-bed7-6b304841abab None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:04.242120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acaa0d-5e12-4b51-869d-013d40470e02 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:04.242405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acaa0d-5e12-4b51-869d-013d40470e02 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:04.242673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acaa0d-5e12-4b51-869d-013d40470e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:04.249529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:04.260670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-58acaa0d-5e12-4b51-869d-013d40470e02 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:04.264633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-58acaa0d-5e12-4b51-869d-013d40470e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:04.278808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a384-b7f6-4ff5-8530-5e42c8fa47f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:04.279794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a384-b7f6-4ff5-8530-5e42c8fa47f3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:04.280279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a384-b7f6-4ff5-8530-5e42c8fa47f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:04.280726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9a384-b7f6-4ff5-8530-5e42c8fa47f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:04.281755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9a384-b7f6-4ff5-8530-5e42c8fa47f3 None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=7db0ec167b464cfea43931cd3c6183e9) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:04.282261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9a384-b7f6-4ff5-8530-5e42c8fa47f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:04.283913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9a384-b7f6-4ff5-8530-5e42c8fa47f3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:04.292881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 348/696] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:04 2022] GET /identity/v3/role_assignments?user.id=7db0ec167b464cfea43931cd3c6183e9&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:04.377613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 349/697] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:18:04.413719 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a384-b7f6-4ff5-8530-5e42c8fa47f3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:04.547330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9a384-b7f6-4ff5-8530-5e42c8fa47f3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:04.582797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d445a-c27c-4681-931d-1cabf804781e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:04.583614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d445a-c27c-4681-931d-1cabf804781e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:04.583894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d445a-c27c-4681-931d-1cabf804781e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:04.584164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d445a-c27c-4681-931d-1cabf804781e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:04.594643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d445a-c27c-4681-931d-1cabf804781e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-372d445a-c27c-4681-931d-1cabf804781e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:04.602643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:04.603581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:04.604655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 349/698] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:04.610333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acaa0d-5e12-4b51-869d-013d40470e02 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:04.694105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:04.721800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acaa0d-5e12-4b51-869d-013d40470e02 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:04.767945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701504e-19e7-404d-8bc3-fd010c561984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:04.768625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701504e-19e7-404d-8bc3-fd010c561984 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:04.768934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701504e-19e7-404d-8bc3-fd010c561984 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:04.769211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701504e-19e7-404d-8bc3-fd010c561984 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:04.769962 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701504e-19e7-404d-8bc3-fd010c561984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:04.770262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701504e-19e7-404d-8bc3-fd010c561984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:04.771654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701504e-19e7-404d-8bc3-fd010c561984 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:04.780652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 350/699] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:04.785797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d445a-c27c-4681-931d-1cabf804781e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:04.818852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:04.896874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d445a-c27c-4681-931d-1cabf804781e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:04.931160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28836193-1f05-49da-aef5-9ae54b9f6669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:04.931972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28836193-1f05-49da-aef5-9ae54b9f6669 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:04.932365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28836193-1f05-49da-aef5-9ae54b9f6669 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:04.932646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28836193-1f05-49da-aef5-9ae54b9f6669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:04.945559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28836193-1f05-49da-aef5-9ae54b9f6669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:04.947039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28836193-1f05-49da-aef5-9ae54b9f6669 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-28836193-1f05-49da-aef5-9ae54b9f6669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:04.964935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:04.965853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:04.966916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:04.966916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:04.966916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:04.966916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:04.966916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 350/700] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:04.971655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701504e-19e7-404d-8bc3-fd010c561984 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:05.079242 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701504e-19e7-404d-8bc3-fd010c561984 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:05.112729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f5e17-1c36-4b01-8d37-7897373680f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:05.113429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5e17-1c36-4b01-8d37-7897373680f3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:05.113709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5e17-1c36-4b01-8d37-7897373680f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:05.113978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f5e17-1c36-4b01-8d37-7897373680f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:05.114696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f5e17-1c36-4b01-8d37-7897373680f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:05.114996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f5e17-1c36-4b01-8d37-7897373680f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:05.116362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f5e17-1c36-4b01-8d37-7897373680f3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:05.118694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:05.136137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 351/701] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:05.141602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28836193-1f05-49da-aef5-9ae54b9f6669 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:05.190796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49424-dfad-4d8c-b0cc-bdb244c06e37 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:05.191123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49424-dfad-4d8c-b0cc-bdb244c06e37 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:05.191354 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad49424-dfad-4d8c-b0cc-bdb244c06e37 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:05.192729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 352/702] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:18:05.197657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c914d18-46ca-42ff-91be-59b2cb789338 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:05.197941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c914d18-46ca-42ff-91be-59b2cb789338 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:05.198216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c914d18-46ca-42ff-91be-59b2cb789338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:05.227069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4c914d18-46ca-42ff-91be-59b2cb789338 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:05.228259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4c914d18-46ca-42ff-91be-59b2cb789338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:05.276177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:05.308066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28836193-1f05-49da-aef5-9ae54b9f6669 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:05.318254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 353/703] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 01 16:18:05.349301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c914d18-46ca-42ff-91be-59b2cb789338 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:05.352980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa1c4c-7a53-436b-8cc3-42f8e8c8e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:05.358496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa1c4c-7a53-436b-8cc3-42f8e8c8e701 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:05.360739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa1c4c-7a53-436b-8cc3-42f8e8c8e701 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:05.360992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa1c4c-7a53-436b-8cc3-42f8e8c8e701 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:05.376068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa1c4c-7a53-436b-8cc3-42f8e8c8e701 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:05.377568 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa1c4c-7a53-436b-8cc3-42f8e8c8e701 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-00fa1c4c-7a53-436b-8cc3-42f8e8c8e701 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:05.402947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:05.404034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:05.405550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 351/704] 10.222.0.59 () {56 vars in 1093 bytes} [Fri Jul 1 16:18:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:05.413627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa1c4c-7a53-436b-8cc3-42f8e8c8e701 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:05.539560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa1c4c-7a53-436b-8cc3-42f8e8c8e701 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:05.550536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c914d18-46ca-42ff-91be-59b2cb789338 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:05.596723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:05.603679 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58882-809c-4cd9-9c47-ca3fbc815718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:05.604380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58882-809c-4cd9-9c47-ca3fbc815718 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:05.604658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58882-809c-4cd9-9c47-ca3fbc815718 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:05.604951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a58882-809c-4cd9-9c47-ca3fbc815718 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:05.605789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a58882-809c-4cd9-9c47-ca3fbc815718 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:05.606424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a58882-809c-4cd9-9c47-ca3fbc815718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:05.607927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a58882-809c-4cd9-9c47-ca3fbc815718 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:05.613432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139528b-67ca-4986-ab86-d129ed758f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:05.614248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139528b-67ca-4986-ab86-d129ed758f6d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:05.614522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139528b-67ca-4986-ab86-d129ed758f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:05.614788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139528b-67ca-4986-ab86-d129ed758f6d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:05.615439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139528b-67ca-4986-ab86-d129ed758f6d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:05.616792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139528b-67ca-4986-ab86-d129ed758f6d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:05.637230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c139528b-67ca-4986-ab86-d129ed758f6d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:05.645107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:05.646134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 16:18:05.647000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:05.650007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 352/705] 10.222.0.59 () {56 vars in 1133 bytes} [Fri Jul 1 16:18:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:05.650243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 354/706] 10.222.0.59 () {56 vars in 1129 bytes} [Fri Jul 1 16:18:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:05.655495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58882-809c-4cd9-9c47-ca3fbc815718 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:05.656763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139528b-67ca-4986-ab86-d129ed758f6d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:05.761101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a58882-809c-4cd9-9c47-ca3fbc815718 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:05.801535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feda40-eac9-4e62-a380-e36e67fdc93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:05.802212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feda40-eac9-4e62-a380-e36e67fdc93b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:05.802490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feda40-eac9-4e62-a380-e36e67fdc93b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:05.802758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79feda40-eac9-4e62-a380-e36e67fdc93b None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:05.803463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feda40-eac9-4e62-a380-e36e67fdc93b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:05.803762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feda40-eac9-4e62-a380-e36e67fdc93b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:05.805170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79feda40-eac9-4e62-a380-e36e67fdc93b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:05.815580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 353/707] 10.222.0.59 () {56 vars in 1124 bytes} [Fri Jul 1 16:18:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:05.819582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feda40-eac9-4e62-a380-e36e67fdc93b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:05.858270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139528b-67ca-4986-ab86-d129ed758f6d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:05.907747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28a76b-4150-4772-ac25-200685c70350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:05.908708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28a76b-4150-4772-ac25-200685c70350 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:05.909019 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28a76b-4150-4772-ac25-200685c70350 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:05.909337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28a76b-4150-4772-ac25-200685c70350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:05.910887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:05.960319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79feda40-eac9-4e62-a380-e36e67fdc93b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:05.985001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:05.998751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28a76b-4150-4772-ac25-200685c70350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:06.000239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d28a76b-4150-4772-ac25-200685c70350 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:06.003328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e675db3-e869-4dca-a250-f6a7cf905829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:06.004084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e675db3-e869-4dca-a250-f6a7cf905829 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.004430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e675db3-e869-4dca-a250-f6a7cf905829 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.004767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e675db3-e869-4dca-a250-f6a7cf905829 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.005567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e675db3-e869-4dca-a250-f6a7cf905829 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:06.005950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e675db3-e869-4dca-a250-f6a7cf905829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:06.007396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e675db3-e869-4dca-a250-f6a7cf905829 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:06.020868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 354/708] 10.222.0.59 () {56 vars in 1124 bytes} [Fri Jul 1 16:18:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:06.020868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849bf12-857a-48eb-87db-0d89dca7a898 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.020868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849bf12-857a-48eb-87db-0d89dca7a898 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.020868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849bf12-857a-48eb-87db-0d89dca7a898 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.020868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 355/709] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:06.036139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b548ddd-99da-494c-a0ec-f8c7fa23664d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.036481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b548ddd-99da-494c-a0ec-f8c7fa23664d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.036680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b548ddd-99da-494c-a0ec-f8c7fa23664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.064888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1b548ddd-99da-494c-a0ec-f8c7fa23664d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:06.066171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1b548ddd-99da-494c-a0ec-f8c7fa23664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:06.199738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 356/710] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 01 16:18:06.207111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 355/711] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:18:06.212515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b548ddd-99da-494c-a0ec-f8c7fa23664d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:06.227743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28a76b-4150-4772-ac25-200685c70350 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:06.282536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:06.337044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b548ddd-99da-494c-a0ec-f8c7fa23664d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:06.357508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:06.374351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d28a76b-4150-4772-ac25-200685c70350 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:06.418266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b5d1-3cbf-43ff-80e0-2e2b169937d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:06.419097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b5d1-3cbf-43ff-80e0-2e2b169937d7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.419444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b5d1-3cbf-43ff-80e0-2e2b169937d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.419719 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66b5d1-3cbf-43ff-80e0-2e2b169937d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.437324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf1148-e19a-43f6-a5aa-1fdc04767c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:06.439048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66b5d1-3cbf-43ff-80e0-2e2b169937d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:06.440346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1148-e19a-43f6-a5aa-1fdc04767c54 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.441185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1148-e19a-43f6-a5aa-1fdc04767c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.443543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66b5d1-3cbf-43ff-80e0-2e2b169937d7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:06.444062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1148-e19a-43f6-a5aa-1fdc04767c54 None admin] PATH_INFO: `/v3/services/network` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.445403 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf1148-e19a-43f6-a5aa-1fdc04767c54 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:06.447176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf1148-e19a-43f6-a5aa-1fdc04767c54 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-80cf1148-e19a-43f6-a5aa-1fdc04767c54 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:06.476320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:06.477409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 16:18:06.478257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4c66b5d1-3cbf-43ff-80e0-2e2b169937d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:06.483832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:06.484707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:06.485727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:06.485727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:06.485727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:06.485727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:06.487584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 356/712] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:06 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:06.489329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 357/713] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:06.497864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b5d1-3cbf-43ff-80e0-2e2b169937d7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:06.498005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf1148-e19a-43f6-a5aa-1fdc04767c54 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:06.620683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66b5d1-3cbf-43ff-80e0-2e2b169937d7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:06.632137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf1148-e19a-43f6-a5aa-1fdc04767c54 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:06.636794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:06.668301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194bd1c-38c8-4f35-a782-46cb3373f3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:06.668528 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e7cd7-871d-4c49-bb59-001207f9f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:06.669006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194bd1c-38c8-4f35-a782-46cb3373f3ac None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.669325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194bd1c-38c8-4f35-a782-46cb3373f3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.669600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194bd1c-38c8-4f35-a782-46cb3373f3ac None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.669920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e7cd7-871d-4c49-bb59-001207f9f033 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.670315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194bd1c-38c8-4f35-a782-46cb3373f3ac None admin] RBAC: Adding query filter params (name=network) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:06.670476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e7cd7-871d-4c49-bb59-001207f9f033 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.670619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194bd1c-38c8-4f35-a782-46cb3373f3ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:06.671021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e7cd7-871d-4c49-bb59-001207f9f033 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.671889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e7cd7-871d-4c49-bb59-001207f9f033 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:06.672051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c194bd1c-38c8-4f35-a782-46cb3373f3ac None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:06.672485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e7cd7-871d-4c49-bb59-001207f9f033 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:06.674825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e7cd7-871d-4c49-bb59-001207f9f033 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:06.677589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 357/714] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:06.679085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3b1b-c269-4e72-8c29-64b3ed31e46c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.679370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3b1b-c269-4e72-8c29-64b3ed31e46c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.679663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3b1b-c269-4e72-8c29-64b3ed31e46c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.685434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 358/715] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:06.686022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3b1b-c269-4e72-8c29-64b3ed31e46c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:06.689667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 358/716] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:06.692098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933fc21-7842-4704-a79e-e05f30db35a1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.692595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933fc21-7842-4704-a79e-e05f30db35a1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.693118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933fc21-7842-4704-a79e-e05f30db35a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.708582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:06.714609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1933fc21-7842-4704-a79e-e05f30db35a1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:06.716369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1933fc21-7842-4704-a79e-e05f30db35a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:06.794781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 359/717] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:18:06.796014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933fc21-7842-4704-a79e-e05f30db35a1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:06.805095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3b1b-c269-4e72-8c29-64b3ed31e46c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:06.854129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60923f-a012-4a67-9274-672a16879d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:06.854896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60923f-a012-4a67-9274-672a16879d84 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.855181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60923f-a012-4a67-9274-672a16879d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.855453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa60923f-a012-4a67-9274-672a16879d84 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.856699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60923f-a012-4a67-9274-672a16879d84 None admin] RBAC: Adding query filter params (type=network) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:06.857170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60923f-a012-4a67-9274-672a16879d84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:06.858577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa60923f-a012-4a67-9274-672a16879d84 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:06.865297 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 359/718] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:06.866282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60923f-a012-4a67-9274-672a16879d84 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:06.914388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:06.918611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933fc21-7842-4704-a79e-e05f30db35a1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:06.958141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4ce33-4c3d-4f15-aaf7-f010e750a221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:06.958968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4ce33-4c3d-4f15-aaf7-f010e750a221 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:06.959245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4ce33-4c3d-4f15-aaf7-f010e750a221 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:06.959517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4ce33-4c3d-4f15-aaf7-f010e750a221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:06.970425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4ce33-4c3d-4f15-aaf7-f010e750a221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:06.972280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4ce33-4c3d-4f15-aaf7-f010e750a221 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:06.995574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c3b4ce33-4c3d-4f15-aaf7-f010e750a221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:07.008770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:07.009772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:07.010697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:07.010697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:07.010697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:07.010697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:07.010697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:07.010697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:07.010697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:07.010697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:07.010697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 360/719] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:07.021984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4ce33-4c3d-4f15-aaf7-f010e750a221 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:07.026704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa60923f-a012-4a67-9274-672a16879d84 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:07.072105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a0d5c-ca66-467e-9b70-3b74ca2e19c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:07.072953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a0d5c-ca66-467e-9b70-3b74ca2e19c0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:07.073235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a0d5c-ca66-467e-9b70-3b74ca2e19c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:07.073510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a0d5c-ca66-467e-9b70-3b74ca2e19c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:07.087722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a0d5c-ca66-467e-9b70-3b74ca2e19c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-916a0d5c-ca66-467e-9b70-3b74ca2e19c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:07.095571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:07.096501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:07.097365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 360/720] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:18:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:07.103464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a0d5c-ca66-467e-9b70-3b74ca2e19c0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:07.165944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4ce33-4c3d-4f15-aaf7-f010e750a221 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:07.211589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a0d5c-ca66-467e-9b70-3b74ca2e19c0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:07.211929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7039a57-e573-4cdf-bfb9-145faaab3ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:07.212579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039a57-e573-4cdf-bfb9-145faaab3ddd None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:07.212884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039a57-e573-4cdf-bfb9-145faaab3ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:07.213173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7039a57-e573-4cdf-bfb9-145faaab3ddd None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:07.214024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7039a57-e573-4cdf-bfb9-145faaab3ddd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:07.214336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7039a57-e573-4cdf-bfb9-145faaab3ddd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:07.215793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7039a57-e573-4cdf-bfb9-145faaab3ddd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:07.229853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 361/721] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:07.236870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7039a57-e573-4cdf-bfb9-145faaab3ddd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:07.269316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:07.279623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595adf0-aaf6-4f05-b77a-7717dafc4aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:07.280302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595adf0-aaf6-4f05-b77a-7717dafc4aaa None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:07.280578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595adf0-aaf6-4f05-b77a-7717dafc4aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:07.280867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595adf0-aaf6-4f05-b77a-7717dafc4aaa None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:07.281618 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595adf0-aaf6-4f05-b77a-7717dafc4aaa None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:07.281915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595adf0-aaf6-4f05-b77a-7717dafc4aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:07.283292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595adf0-aaf6-4f05-b77a-7717dafc4aaa None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:07.299148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 361/722] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:18:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:07.300826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7314cd-58c9-4352-a108-db30ac9fce19 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:07.301337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7314cd-58c9-4352-a108-db30ac9fce19 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:07.301826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7314cd-58c9-4352-a108-db30ac9fce19 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:07.303527 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 362/723] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:07.307598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7314cd-58c9-4352-a108-db30ac9fce19 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:07.311831 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:07.375234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7039a57-e573-4cdf-bfb9-145faaab3ddd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:07.420512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eb674-1f3c-40b9-9f89-adbf96519b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:07.421718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eb674-1f3c-40b9-9f89-adbf96519b08 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:07.422097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eb674-1f3c-40b9-9f89-adbf96519b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:07.422706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eb674-1f3c-40b9-9f89-adbf96519b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:07.423645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eb674-1f3c-40b9-9f89-adbf96519b08 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=efdfb91ba4c04452ba547baa184185c4) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:07.424212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eb674-1f3c-40b9-9f89-adbf96519b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:07.426035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128eb674-1f3c-40b9-9f89-adbf96519b08 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:07.432967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7314cd-58c9-4352-a108-db30ac9fce19 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:07.441173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 362/724] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:07 2022] GET /identity/v3/role_assignments?user.id=efdfb91ba4c04452ba547baa184185c4&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=842af9e8967047df873d061df391e820 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:07.442768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da19cc8-434b-40e0-94b3-096087686c6f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:07.443056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da19cc8-434b-40e0-94b3-096087686c6f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:07.443333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da19cc8-434b-40e0-94b3-096087686c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:07.476781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078d5f5-ca5b-4d38-a5c7-cc85a6f982e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:07.479365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078d5f5-ca5b-4d38-a5c7-cc85a6f982e0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:07.479365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078d5f5-ca5b-4d38-a5c7-cc85a6f982e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:07.479365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078d5f5-ca5b-4d38-a5c7-cc85a6f982e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:07.482929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2da19cc8-434b-40e0-94b3-096087686c6f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:07.484500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2da19cc8-434b-40e0-94b3-096087686c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:07.493538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078d5f5-ca5b-4d38-a5c7-cc85a6f982e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:07.496487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078d5f5-ca5b-4d38-a5c7-cc85a6f982e0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-7078d5f5-ca5b-4d38-a5c7-cc85a6f982e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:07.524931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:07.525941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:07.526809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:07.526809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:07.526809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:07.526809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:07.526809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 363/725] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:07.534243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078d5f5-ca5b-4d38-a5c7-cc85a6f982e0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:07.631629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 363/726] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:18:07.649136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:07.658485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da19cc8-434b-40e0-94b3-096087686c6f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:07.685869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:07.721935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078d5f5-ca5b-4d38-a5c7-cc85a6f982e0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:07.811685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da19cc8-434b-40e0-94b3-096087686c6f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:07.818482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941975e4-5073-44d8-b0ae-94a26fa3d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:07.819162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941975e4-5073-44d8-b0ae-94a26fa3d8bd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:07.819437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941975e4-5073-44d8-b0ae-94a26fa3d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:07.819712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941975e4-5073-44d8-b0ae-94a26fa3d8bd None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:07.820440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941975e4-5073-44d8-b0ae-94a26fa3d8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:07.820736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941975e4-5073-44d8-b0ae-94a26fa3d8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:07.822210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941975e4-5073-44d8-b0ae-94a26fa3d8bd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:07.849468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 364/727] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:07.851045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bec54d-3a05-4cad-a748-872fc2c32c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:07.852096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bec54d-3a05-4cad-a748-872fc2c32c88 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:07.852571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bec54d-3a05-4cad-a748-872fc2c32c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:07.853151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bec54d-3a05-4cad-a748-872fc2c32c88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:07.854444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941975e4-5073-44d8-b0ae-94a26fa3d8bd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:07.865585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bec54d-3a05-4cad-a748-872fc2c32c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-83bec54d-3a05-4cad-a748-872fc2c32c88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:07.874072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:07.875034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:07.875857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:07.878709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 364/728] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:07.884952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bec54d-3a05-4cad-a748-872fc2c32c88 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:07.971587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:08.003426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bec54d-3a05-4cad-a748-872fc2c32c88 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:08.069759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941975e4-5073-44d8-b0ae-94a26fa3d8bd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:08.082854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a48b5c-ed31-40c8-95eb-e0d1d51ce0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:08.083539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a48b5c-ed31-40c8-95eb-e0d1d51ce0cc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:08.083817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a48b5c-ed31-40c8-95eb-e0d1d51ce0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:08.084078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a48b5c-ed31-40c8-95eb-e0d1d51ce0cc None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:08.084836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a48b5c-ed31-40c8-95eb-e0d1d51ce0cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:08.085155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a48b5c-ed31-40c8-95eb-e0d1d51ce0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:08.086538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a48b5c-ed31-40c8-95eb-e0d1d51ce0cc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:08.087312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:08.102274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 365/729] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:08.112266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a48b5c-ed31-40c8-95eb-e0d1d51ce0cc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:08.121208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a8139-8c70-4617-9dec-d7a8072ed3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:08.122052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a8139-8c70-4617-9dec-d7a8072ed3ee None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:08.122398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a8139-8c70-4617-9dec-d7a8072ed3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:08.122695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a8139-8c70-4617-9dec-d7a8072ed3ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:08.135913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a8139-8c70-4617-9dec-d7a8072ed3ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:08.137416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a8139-8c70-4617-9dec-d7a8072ed3ee None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-051a8139-8c70-4617-9dec-d7a8072ed3ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:08.164081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:08.165092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:08.166084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 365/730] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:18:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:08.171174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a8139-8c70-4617-9dec-d7a8072ed3ee None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:08.294451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a48b5c-ed31-40c8-95eb-e0d1d51ce0cc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:08.343225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a8139-8c70-4617-9dec-d7a8072ed3ee None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:08.348004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2029c-5508-4ac9-a355-812007637200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:08.348835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2029c-5508-4ac9-a355-812007637200 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:08.349151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2029c-5508-4ac9-a355-812007637200 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:08.349437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2029c-5508-4ac9-a355-812007637200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:08.353598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:08.368223 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2029c-5508-4ac9-a355-812007637200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:08.370024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2029c-5508-4ac9-a355-812007637200 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:08.382126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac66dace-88f2-44c2-b3e2-ab306910b244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:08.382802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66dace-88f2-44c2-b3e2-ab306910b244 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:08.383077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66dace-88f2-44c2-b3e2-ab306910b244 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:08.383351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac66dace-88f2-44c2-b3e2-ab306910b244 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:08.384180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66dace-88f2-44c2-b3e2-ab306910b244 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:08.384482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66dace-88f2-44c2-b3e2-ab306910b244 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:08.385949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac66dace-88f2-44c2-b3e2-ab306910b244 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-dba2029c-5508-4ac9-a355-812007637200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:08.392109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:08.393045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:08.393956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:08.393956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:08.393956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:08.393956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:08.395056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 366/731] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:08.396563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55396298-1ed1-4763-bed6-a6d397a0d202 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:08.397234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55396298-1ed1-4763-bed6-a6d397a0d202 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:08.397794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55396298-1ed1-4763-bed6-a6d397a0d202 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:08.403428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 367/732] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:08.404558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55396298-1ed1-4763-bed6-a6d397a0d202 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:08.412028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 366/733] 10.222.0.59 () {56 vars in 1149 bytes} [Fri Jul 1 16:18:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:08.417852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82444c2-6b5f-4943-bf29-3a4a8396fae3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:08.418209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82444c2-6b5f-4943-bf29-3a4a8396fae3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:08.418556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82444c2-6b5f-4943-bf29-3a4a8396fae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:08.434676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f82444c2-6b5f-4943-bf29-3a4a8396fae3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:08.436023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f82444c2-6b5f-4943-bf29-3a4a8396fae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:08.463873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:08.509439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 367/734] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:18:08.510588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82444c2-6b5f-4943-bf29-3a4a8396fae3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:08.523772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55396298-1ed1-4763-bed6-a6d397a0d202 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:08.572139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744246-22c8-477f-9dcb-bb9dd3d1f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:08.573218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744246-22c8-477f-9dcb-bb9dd3d1f101 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:08.573731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744246-22c8-477f-9dcb-bb9dd3d1f101 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:08.574206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744246-22c8-477f-9dcb-bb9dd3d1f101 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:08.575128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744246-22c8-477f-9dcb-bb9dd3d1f101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:08.575690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744246-22c8-477f-9dcb-bb9dd3d1f101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:08.577302 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76744246-22c8-477f-9dcb-bb9dd3d1f101 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:08.590123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 368/735] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:08.591215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744246-22c8-477f-9dcb-bb9dd3d1f101 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:08.616058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82444c2-6b5f-4943-bf29-3a4a8396fae3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:08.641567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:08.653391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec3b52-95a3-49d5-a529-0c0860ba8b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:08.654078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec3b52-95a3-49d5-a529-0c0860ba8b5e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:08.654363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec3b52-95a3-49d5-a529-0c0860ba8b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:08.654641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec3b52-95a3-49d5-a529-0c0860ba8b5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:08.693248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:08.697237 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744246-22c8-477f-9dcb-bb9dd3d1f101 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:08.729531 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec3b52-95a3-49d5-a529-0c0860ba8b5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:08.731516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec3b52-95a3-49d5-a529-0c0860ba8b5e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:08.734197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f014e-24cc-43a1-9064-04a2c8848ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:08.735247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f014e-24cc-43a1-9064-04a2c8848ec7 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:08.735898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f014e-24cc-43a1-9064-04a2c8848ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:08.736395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f014e-24cc-43a1-9064-04a2c8848ec7 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:08.737385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f014e-24cc-43a1-9064-04a2c8848ec7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:08.738987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f014e-24cc-43a1-9064-04a2c8848ec7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:08.765021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 369/736] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:18:08 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:08.766576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f014e-24cc-43a1-9064-04a2c8848ec7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:08.896598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 368/737] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:18:08.900533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec3b52-95a3-49d5-a529-0c0860ba8b5e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:08.986475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f014e-24cc-43a1-9064-04a2c8848ec7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:08.991921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:09.029054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:09.032634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0978-c358-42a9-8c53-9705caa39ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:09.034013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0978-c358-42a9-8c53-9705caa39ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.034736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0978-c358-42a9-8c53-9705caa39ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.035161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203c0978-c358-42a9-8c53-9705caa39ba0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.044946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0978-c358-42a9-8c53-9705caa39ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:09.047147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203c0978-c358-42a9-8c53-9705caa39ba0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:09.057209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec3b52-95a3-49d5-a529-0c0860ba8b5e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-203c0978-c358-42a9-8c53-9705caa39ba0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:09.068118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:09.069330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:18:09.070523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:09.072938 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 370/738] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:09.078905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0978-c358-42a9-8c53-9705caa39ba0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:09.118034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a5195-9e91-42e0-9af6-5df3473d9080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:09.118978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5195-9e91-42e0-9af6-5df3473d9080 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.119261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5195-9e91-42e0-9af6-5df3473d9080 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.119782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a5195-9e91-42e0-9af6-5df3473d9080 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.133352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a5195-9e91-42e0-9af6-5df3473d9080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:09.134817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a5195-9e91-42e0-9af6-5df3473d9080 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-065a5195-9e91-42e0-9af6-5df3473d9080 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:09.157473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:09.158393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:09.159300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:09.159300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:09.159300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:09.159300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:09.159300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 369/739] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:09.164485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a5195-9e91-42e0-9af6-5df3473d9080 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:09.217192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203c0978-c358-42a9-8c53-9705caa39ba0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:09.267573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0c056-8d16-45c6-a15e-fe862f27c9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:09.268275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c056-8d16-45c6-a15e-fe862f27c9cf None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.268558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c056-8d16-45c6-a15e-fe862f27c9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.272867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0c056-8d16-45c6-a15e-fe862f27c9cf None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.272867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0c056-8d16-45c6-a15e-fe862f27c9cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:09.272867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0c056-8d16-45c6-a15e-fe862f27c9cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:09.272867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0c056-8d16-45c6-a15e-fe862f27c9cf None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:09.292013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a5195-9e91-42e0-9af6-5df3473d9080 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:09.314797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 371/740] 10.222.0.59 () {56 vars in 1135 bytes} [Fri Jul 1 16:18:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:09.320589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0c056-8d16-45c6-a15e-fe862f27c9cf None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:09.333163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:09.361853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b93941-4e3c-4caf-960a-5cc374e916d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:09.364067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93941-4e3c-4caf-960a-5cc374e916d5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.364756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93941-4e3c-4caf-960a-5cc374e916d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.366139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93941-4e3c-4caf-960a-5cc374e916d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.369696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93941-4e3c-4caf-960a-5cc374e916d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:09.370226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93941-4e3c-4caf-960a-5cc374e916d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:09.371819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93941-4e3c-4caf-960a-5cc374e916d5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:09.377326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:09.389714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 370/741] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:09.391995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8398-978f-4dc1-9525-b058a4266491 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.392288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8398-978f-4dc1-9525-b058a4266491 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.392567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b8398-978f-4dc1-9525-b058a4266491 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.396924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 371/742] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:09.397948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8398-978f-4dc1-9525-b058a4266491 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:09.462313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0c056-8d16-45c6-a15e-fe862f27c9cf None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:09.499913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6ac96-1a13-44a1-9277-d5d48c44399c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:09.501102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ac96-1a13-44a1-9277-d5d48c44399c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.501765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ac96-1a13-44a1-9277-d5d48c44399c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.502259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ac96-1a13-44a1-9277-d5d48c44399c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.530971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b8398-978f-4dc1-9525-b058a4266491 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:09.575682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd02781-cd0d-4eaa-9dcf-c5b3a4c018b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:09.576735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd02781-cd0d-4eaa-9dcf-c5b3a4c018b9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.577437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd02781-cd0d-4eaa-9dcf-c5b3a4c018b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.577722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd02781-cd0d-4eaa-9dcf-c5b3a4c018b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.584641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6ac96-1a13-44a1-9277-d5d48c44399c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:09.586305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd02781-cd0d-4eaa-9dcf-c5b3a4c018b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:09.586569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6ac96-1a13-44a1-9277-d5d48c44399c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:09.587772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd02781-cd0d-4eaa-9dcf-c5b3a4c018b9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4fd02781-cd0d-4eaa-9dcf-c5b3a4c018b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:09.607220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:09.608235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:09.609178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:09.609178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:09.609178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:09.609178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:09.609178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:09.609178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:09.609178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:09.609178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:09.609608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 372/743] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:09.610602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38ea1f-7e36-4a1d-a71d-e93b81e7b726 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.610893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38ea1f-7e36-4a1d-a71d-e93b81e7b726 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.611175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38ea1f-7e36-4a1d-a71d-e93b81e7b726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.620506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:09.635410 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9a38ea1f-7e36-4a1d-a71d-e93b81e7b726 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:09.636884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9a38ea1f-7e36-4a1d-a71d-e93b81e7b726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:09.670532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:09.711278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 373/744] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:18:09.711278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38ea1f-7e36-4a1d-a71d-e93b81e7b726 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:09.711710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 372/745] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:09 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 01 16:18:09.713958 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1198-028d-4fc2-9d60-0561a7a5dd12 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.714192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1198-028d-4fc2-9d60-0561a7a5dd12 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.714469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c1198-028d-4fc2-9d60-0561a7a5dd12 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.716916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 373/746] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:09.717997 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1198-028d-4fc2-9d60-0561a7a5dd12 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:09.824650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38ea1f-7e36-4a1d-a71d-e93b81e7b726 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:09.831195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c1198-028d-4fc2-9d60-0561a7a5dd12 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:09.854623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:09.865889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24414066-ba68-42a4-a422-320aa0094d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:09.866562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414066-ba68-42a4-a422-320aa0094d47 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.866882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414066-ba68-42a4-a422-320aa0094d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.867112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414066-ba68-42a4-a422-320aa0094d47 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.867899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24414066-ba68-42a4-a422-320aa0094d47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:09.868203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24414066-ba68-42a4-a422-320aa0094d47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:09.868733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d526a-a0ea-48de-9855-4263eafb60f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:09.869563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d526a-a0ea-48de-9855-4263eafb60f9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.869661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24414066-ba68-42a4-a422-320aa0094d47 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:09.869851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d526a-a0ea-48de-9855-4263eafb60f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.870126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d526a-a0ea-48de-9855-4263eafb60f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.880778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d526a-a0ea-48de-9855-4263eafb60f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:09.886492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 374/747] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:09.886622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d526a-a0ea-48de-9855-4263eafb60f9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:09.886699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d612cf-dbf7-418d-9e96-b71b33c7b0d8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:09.886699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d612cf-dbf7-418d-9e96-b71b33c7b0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:09.886699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d612cf-dbf7-418d-9e96-b71b33c7b0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:09.902023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-66d612cf-dbf7-418d-9e96-b71b33c7b0d8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:09.903451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-66d612cf-dbf7-418d-9e96-b71b33c7b0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-413d526a-a0ea-48de-9855-4263eafb60f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:09.904445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:09.905332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:09.906231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:09.906231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:09.906231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:09.906231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:09.906231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 374/748] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:09.907011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d526a-a0ea-48de-9855-4263eafb60f9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:09.930330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:09.985693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 375/749] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 01 16:18:09.985693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d612cf-dbf7-418d-9e96-b71b33c7b0d8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:10.015900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d526a-a0ea-48de-9855-4263eafb60f9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:10.053311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7ea9-aa65-483a-9cc2-9ab10dd12169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:10.053988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7ea9-aa65-483a-9cc2-9ab10dd12169 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:10.054271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7ea9-aa65-483a-9cc2-9ab10dd12169 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:10.054553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7ea9-aa65-483a-9cc2-9ab10dd12169 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:10.055279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a7ea9-aa65-483a-9cc2-9ab10dd12169 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:10.056678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a7ea9-aa65-483a-9cc2-9ab10dd12169 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:10.072589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 375/750] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:18:09 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:10.073526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7ea9-aa65-483a-9cc2-9ab10dd12169 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:10.112166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:10.119874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d612cf-dbf7-418d-9e96-b71b33c7b0d8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:10.197456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7ea9-aa65-483a-9cc2-9ab10dd12169 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:10.199986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d48f52-7e45-4751-a86a-a8074fd206cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:10.200671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d48f52-7e45-4751-a86a-a8074fd206cc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:10.201048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d48f52-7e45-4751-a86a-a8074fd206cc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:10.201329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d48f52-7e45-4751-a86a-a8074fd206cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:10.202184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d48f52-7e45-4751-a86a-a8074fd206cc None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=437bdb7c923e483eb39f448c42e4e787) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:10.202519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d48f52-7e45-4751-a86a-a8074fd206cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:10.204004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d48f52-7e45-4751-a86a-a8074fd206cc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:10.210974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 376/751] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:09 2022] GET /identity/v3/role_assignments?user.id=437bdb7c923e483eb39f448c42e4e787&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:10.211916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d48f52-7e45-4751-a86a-a8074fd206cc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:10.232530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:10.257907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dcd5e-2eb7-4a3f-a3b5-7e3e45ed347a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:10.259016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dcd5e-2eb7-4a3f-a3b5-7e3e45ed347a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:10.260249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dcd5e-2eb7-4a3f-a3b5-7e3e45ed347a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:10.260825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01dcd5e-2eb7-4a3f-a3b5-7e3e45ed347a None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:10.261845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dcd5e-2eb7-4a3f-a3b5-7e3e45ed347a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:10.263209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dcd5e-2eb7-4a3f-a3b5-7e3e45ed347a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:10.265657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01dcd5e-2eb7-4a3f-a3b5-7e3e45ed347a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:10.283856 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 376/752] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:10.292699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dcd5e-2eb7-4a3f-a3b5-7e3e45ed347a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:10.330662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d48f52-7e45-4751-a86a-a8074fd206cc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:10.369170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7efd-80b6-4b22-b5a8-5824b5aff5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:10.370106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7efd-80b6-4b22-b5a8-5824b5aff5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:10.370457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7efd-80b6-4b22-b5a8-5824b5aff5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:10.370800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa7efd-80b6-4b22-b5a8-5824b5aff5e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:10.383731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa7efd-80b6-4b22-b5a8-5824b5aff5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-10aa7efd-80b6-4b22-b5a8-5824b5aff5e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:10.392424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:10.393437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:10.394302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:10.394924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 377/753] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:10.400828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7efd-80b6-4b22-b5a8-5824b5aff5e4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:10.419385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:10.427202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01dcd5e-2eb7-4a3f-a3b5-7e3e45ed347a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:10.464579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab77f0-220e-4ce6-9b86-2fc24af0596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:10.465656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab77f0-220e-4ce6-9b86-2fc24af0596a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:10.465988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab77f0-220e-4ce6-9b86-2fc24af0596a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:10.466264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab77f0-220e-4ce6-9b86-2fc24af0596a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:10.473879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab77f0-220e-4ce6-9b86-2fc24af0596a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:10.475370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab77f0-220e-4ce6-9b86-2fc24af0596a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:10.488101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9fab77f0-220e-4ce6-9b86-2fc24af0596a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:10.490713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:10.491799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:10.492756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:10.492756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:10.492756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:10.492756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:10.492756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:10.492756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:10.492756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:10.492756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:10.493237 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 377/754] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:10.499259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab77f0-220e-4ce6-9b86-2fc24af0596a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:10.517689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa7efd-80b6-4b22-b5a8-5824b5aff5e4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:10.562357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05f8c-77fd-47de-8846-0a2a60170cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:10.563408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05f8c-77fd-47de-8846-0a2a60170cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:10.564604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05f8c-77fd-47de-8846-0a2a60170cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:10.565117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d05f8c-77fd-47de-8846-0a2a60170cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:10.569100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d05f8c-77fd-47de-8846-0a2a60170cf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:10.569626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d05f8c-77fd-47de-8846-0a2a60170cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:10.571209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d05f8c-77fd-47de-8846-0a2a60170cf4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:10.589369 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 378/755] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:10.594636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05f8c-77fd-47de-8846-0a2a60170cf4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:10.691964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab77f0-220e-4ce6-9b86-2fc24af0596a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:10.764236 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4a43a-429e-4819-82fa-6e3d7230374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:10.768317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4a43a-429e-4819-82fa-6e3d7230374d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:10.768764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4a43a-429e-4819-82fa-6e3d7230374d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:10.769225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4a43a-429e-4819-82fa-6e3d7230374d None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:10.770247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4a43a-429e-4819-82fa-6e3d7230374d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:10.770752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4a43a-429e-4819-82fa-6e3d7230374d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:10.772396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4a43a-429e-4819-82fa-6e3d7230374d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:10.785924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 378/756] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:10.792959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4a43a-429e-4819-82fa-6e3d7230374d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:10.793091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d05f8c-77fd-47de-8846-0a2a60170cf4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:10.823143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:10.845535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ad1c-8181-4eb2-93e9-62e405e1cab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:10.846351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ad1c-8181-4eb2-93e9-62e405e1cab4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:10.846628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ad1c-8181-4eb2-93e9-62e405e1cab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:10.846896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b722ad1c-8181-4eb2-93e9-62e405e1cab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:10.859931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:10.873487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722ad1c-8181-4eb2-93e9-62e405e1cab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:10.874971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b722ad1c-8181-4eb2-93e9-62e405e1cab4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b722ad1c-8181-4eb2-93e9-62e405e1cab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:10.903230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:10.904321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:10.905269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:10.905269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:10.905269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:10.905269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:10.915209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 379/757] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:10.916111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ad1c-8181-4eb2-93e9-62e405e1cab4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:10.979346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4a43a-429e-4819-82fa-6e3d7230374d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:11.045733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f6f39-e4eb-4670-a12f-2fd40c924783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:11.046318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f6f39-e4eb-4670-a12f-2fd40c924783 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:11.046595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f6f39-e4eb-4670-a12f-2fd40c924783 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:11.046863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f6f39-e4eb-4670-a12f-2fd40c924783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:11.047697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f6f39-e4eb-4670-a12f-2fd40c924783 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=7db0ec167b464cfea43931cd3c6183e9) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:11.048004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f6f39-e4eb-4670-a12f-2fd40c924783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:11.049492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f6f39-e4eb-4670-a12f-2fd40c924783 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:11.063994 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 379/758] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:10 2022] GET /identity/v3/role_assignments?user.id=7db0ec167b464cfea43931cd3c6183e9&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=842af9e8967047df873d061df391e820 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:11.103311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b722ad1c-8181-4eb2-93e9-62e405e1cab4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:11.162738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4336-0db9-45df-822b-bb3bd995d4ff None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:11.163424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4336-0db9-45df-822b-bb3bd995d4ff None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:11.163909 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4336-0db9-45df-822b-bb3bd995d4ff None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:11.165811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 380/759] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:18:11.170396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf572cbd-6211-49a2-bf6d-dc3052630a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:11.171102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf572cbd-6211-49a2-bf6d-dc3052630a12 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:11.171379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf572cbd-6211-49a2-bf6d-dc3052630a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:11.171649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf572cbd-6211-49a2-bf6d-dc3052630a12 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:11.172396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf572cbd-6211-49a2-bf6d-dc3052630a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:11.172699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf572cbd-6211-49a2-bf6d-dc3052630a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:11.173171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce76687-bcfb-4ccf-af62-821cf9b52c87 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:11.173678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce76687-bcfb-4ccf-af62-821cf9b52c87 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:11.174163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf572cbd-6211-49a2-bf6d-dc3052630a12 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:11.174271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce76687-bcfb-4ccf-af62-821cf9b52c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:11.189044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 380/760] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:11.198378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf572cbd-6211-49a2-bf6d-dc3052630a12 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:11.209934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6ce76687-bcfb-4ccf-af62-821cf9b52c87 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:11.211939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6ce76687-bcfb-4ccf-af62-821cf9b52c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:11.269202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:11.343535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 381/761] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:18:11.357126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf572cbd-6211-49a2-bf6d-dc3052630a12 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:11.367096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce76687-bcfb-4ccf-af62-821cf9b52c87 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:11.378165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:11.423773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a3465-1959-4374-82a7-befc6bd09c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:11.424577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a3465-1959-4374-82a7-befc6bd09c09 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:11.424871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a3465-1959-4374-82a7-befc6bd09c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:11.425251 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a3465-1959-4374-82a7-befc6bd09c09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:11.435949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a3465-1959-4374-82a7-befc6bd09c09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:11.439172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a3465-1959-4374-82a7-befc6bd09c09 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-d00a3465-1959-4374-82a7-befc6bd09c09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:11.470965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:11.471955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:11.472894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 381/762] 10.222.0.59 () {56 vars in 1093 bytes} [Fri Jul 1 16:18:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:11.480651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a3465-1959-4374-82a7-befc6bd09c09 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:11.551331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce76687-bcfb-4ccf-af62-821cf9b52c87 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:11.616665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a3465-1959-4374-82a7-befc6bd09c09 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:11.625203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c188fa-184c-4ea4-95d1-79293b48b7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:11.626104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c188fa-184c-4ea4-95d1-79293b48b7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:11.626314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c188fa-184c-4ea4-95d1-79293b48b7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:11.626587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c188fa-184c-4ea4-95d1-79293b48b7a2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:11.627257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c188fa-184c-4ea4-95d1-79293b48b7a2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:11.628587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:11.628699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c188fa-184c-4ea4-95d1-79293b48b7a2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-34c188fa-184c-4ea4-95d1-79293b48b7a2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:11.651383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:11.652377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 16:18:11.653482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:11.654289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 382/763] 10.222.0.59 () {56 vars in 1129 bytes} [Fri Jul 1 16:18:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:11.659736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c188fa-184c-4ea4-95d1-79293b48b7a2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:11.706136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39bff-76bc-4a09-9026-761a3c4bb5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:11.706836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39bff-76bc-4a09-9026-761a3c4bb5ce None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:11.707121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39bff-76bc-4a09-9026-761a3c4bb5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:11.707393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f39bff-76bc-4a09-9026-761a3c4bb5ce None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:11.708243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f39bff-76bc-4a09-9026-761a3c4bb5ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:11.708552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f39bff-76bc-4a09-9026-761a3c4bb5ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:11.710047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f39bff-76bc-4a09-9026-761a3c4bb5ce None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:11.740597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:11.756938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 382/764] 10.222.0.59 () {56 vars in 1133 bytes} [Fri Jul 1 16:18:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:11.765931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39bff-76bc-4a09-9026-761a3c4bb5ce None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:11.779015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c188fa-184c-4ea4-95d1-79293b48b7a2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:11.816432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f407da-d82d-454e-b7eb-a30bfbdb921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:11.817327 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f407da-d82d-454e-b7eb-a30bfbdb921f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:11.817610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f407da-d82d-454e-b7eb-a30bfbdb921f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:11.817888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f407da-d82d-454e-b7eb-a30bfbdb921f None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:11.818757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f407da-d82d-454e-b7eb-a30bfbdb921f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:11.819067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f407da-d82d-454e-b7eb-a30bfbdb921f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:11.820536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f407da-d82d-454e-b7eb-a30bfbdb921f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:11.825731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 383/765] 10.222.0.59 () {56 vars in 1124 bytes} [Fri Jul 1 16:18:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:11.831136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f407da-d82d-454e-b7eb-a30bfbdb921f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:11.945216 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f407da-d82d-454e-b7eb-a30bfbdb921f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:11.991098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e0fc8-fca7-4f8f-86eb-80573027f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:11.991649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e0fc8-fca7-4f8f-86eb-80573027f46d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:11.991933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e0fc8-fca7-4f8f-86eb-80573027f46d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:11.992209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e0fc8-fca7-4f8f-86eb-80573027f46d None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:11.992951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e0fc8-fca7-4f8f-86eb-80573027f46d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:11.993261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e0fc8-fca7-4f8f-86eb-80573027f46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:11.994854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e0fc8-fca7-4f8f-86eb-80573027f46d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:12.002206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:12.011168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 384/766] 10.222.0.59 () {56 vars in 1124 bytes} [Fri Jul 1 16:18:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:12.017496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e0fc8-fca7-4f8f-86eb-80573027f46d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:12.024988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f39bff-76bc-4a09-9026-761a3c4bb5ce None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:12.062608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88665c2a-77d9-4f65-9337-4c060d503839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:12.063794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88665c2a-77d9-4f65-9337-4c060d503839 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.064266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88665c2a-77d9-4f65-9337-4c060d503839 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.064753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88665c2a-77d9-4f65-9337-4c060d503839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.076056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88665c2a-77d9-4f65-9337-4c060d503839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:12.077830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88665c2a-77d9-4f65-9337-4c060d503839 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-88665c2a-77d9-4f65-9337-4c060d503839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:12.117016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:12.118068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:12.118928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:12.118928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:12.118928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:12.118928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:12.118928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 383/767] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:12.139360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88665c2a-77d9-4f65-9337-4c060d503839 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:12.171760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e0fc8-fca7-4f8f-86eb-80573027f46d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:12.193216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:12.209351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ced2e-6520-4730-baf5-5a2b00e33c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:12.210512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ced2e-6520-4730-baf5-5a2b00e33c4a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.211356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ced2e-6520-4730-baf5-5a2b00e33c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.211848 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ced2e-6520-4730-baf5-5a2b00e33c4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.212866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ced2e-6520-4730-baf5-5a2b00e33c4a None admin] RBAC: Adding query filter params (interface=public, service_id=ba7846f4cfdf454f93d7988c16d64b81, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:12.213398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ced2e-6520-4730-baf5-5a2b00e33c4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:12.214982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ced2e-6520-4730-baf5-5a2b00e33c4a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:12.224778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 385/768] 10.222.0.59 () {56 vars in 1251 bytes} [Fri Jul 1 16:18:12 2022] GET /identity/v3/endpoints?service_id=ba7846f4cfdf454f93d7988c16d64b81&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:12.236796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ced2e-6520-4730-baf5-5a2b00e33c4a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:12.323349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88665c2a-77d9-4f65-9337-4c060d503839 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:12.365455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d041a-e9ac-4097-94eb-fc977e95ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:12.366187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d041a-e9ac-4097-94eb-fc977e95ed9c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.366469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d041a-e9ac-4097-94eb-fc977e95ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.366742 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d041a-e9ac-4097-94eb-fc977e95ed9c None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.367768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d041a-e9ac-4097-94eb-fc977e95ed9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:12.368075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d041a-e9ac-4097-94eb-fc977e95ed9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:12.370233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d041a-e9ac-4097-94eb-fc977e95ed9c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:12.373298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:12.388158 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 384/769] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:12.396888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d041a-e9ac-4097-94eb-fc977e95ed9c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:12.477060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ced2e-6520-4730-baf5-5a2b00e33c4a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:12.486716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:12.513506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d041a-e9ac-4097-94eb-fc977e95ed9c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:12.546714 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f524548-7adc-4c74-9673-39ad50a65f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:12.547383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f524548-7adc-4c74-9673-39ad50a65f9b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.547673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f524548-7adc-4c74-9673-39ad50a65f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.547952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f524548-7adc-4c74-9673-39ad50a65f9b None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.548768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f524548-7adc-4c74-9673-39ad50a65f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:12.550102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f524548-7adc-4c74-9673-39ad50a65f9b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:12.555539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 386/770] 10.222.0.59 () {56 vars in 1087 bytes} [Fri Jul 1 16:18:12 2022] GET /identity/v3/services => generated 772 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:12.560884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c391929-f9bc-4412-af8b-964c6b1a4c49 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.560884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c391929-f9bc-4412-af8b-964c6b1a4c49 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.560884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c391929-f9bc-4412-af8b-964c6b1a4c49 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.563163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 387/771] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:12.564501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614146-8609-4248-900d-90d4047a4d2f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.564816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614146-8609-4248-900d-90d4047a4d2f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.565143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d614146-8609-4248-900d-90d4047a4d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.589176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1dde-d86d-487b-bea3-0e594606671e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:12.590003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1dde-d86d-487b-bea3-0e594606671e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.590286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1dde-d86d-487b-bea3-0e594606671e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.590562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d1dde-d86d-487b-bea3-0e594606671e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.599341 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7d614146-8609-4248-900d-90d4047a4d2f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:12.600597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7d614146-8609-4248-900d-90d4047a4d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:12.609796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1dde-d86d-487b-bea3-0e594606671e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:12.611302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d1dde-d86d-487b-bea3-0e594606671e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-cc9d1dde-d86d-487b-bea3-0e594606671e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:12.633138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:12.634099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:12.635017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:12.635017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:12.635017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:12.635017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:12.635017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:12.635017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:12.635017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:12.635017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:12.635017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 385/772] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:12.646141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1dde-d86d-487b-bea3-0e594606671e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:12.709011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 388/773] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:12.755182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d614146-8609-4248-900d-90d4047a4d2f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:12.828205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d1dde-d86d-487b-bea3-0e594606671e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:12.830628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:12.866539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e5719-e461-49d4-a47b-df871a8a8354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:12.867277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e5719-e461-49d4-a47b-df871a8a8354 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.867692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e5719-e461-49d4-a47b-df871a8a8354 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.867969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e5719-e461-49d4-a47b-df871a8a8354 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.868797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e5719-e461-49d4-a47b-df871a8a8354 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:12.869133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e5719-e461-49d4-a47b-df871a8a8354 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:12.870749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e5719-e461-49d4-a47b-df871a8a8354 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:12.880385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:12.881050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d614146-8609-4248-900d-90d4047a4d2f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:12.884192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 386/774] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:12.885520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdf381-bf98-4ab1-84d9-83c19f5a91f6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.885808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdf381-bf98-4ab1-84d9-83c19f5a91f6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.886081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdf381-bf98-4ab1-84d9-83c19f5a91f6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.892452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 387/775] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:12.893375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdf381-bf98-4ab1-84d9-83c19f5a91f6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:12.918666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec66f5-34cf-43b4-8412-896532a9069c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:12.919584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec66f5-34cf-43b4-8412-896532a9069c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.919867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec66f5-34cf-43b4-8412-896532a9069c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.920144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec66f5-34cf-43b4-8412-896532a9069c None admin] PATH_INFO: `/v3/services/network` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.920808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec66f5-34cf-43b4-8412-896532a9069c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:12.922417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec66f5-34cf-43b4-8412-896532a9069c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a0ec66f5-34cf-43b4-8412-896532a9069c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:12.935371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:12.936385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:12.937300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 389/776] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:12 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:12.938617 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c62f-37a5-4d84-91ee-c59d2141f6d9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:12.938617 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c62f-37a5-4d84-91ee-c59d2141f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:12.938904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9c62f-37a5-4d84-91ee-c59d2141f6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:12.964011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-20f9c62f-37a5-4d84-91ee-c59d2141f6d9 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:12.965930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-20f9c62f-37a5-4d84-91ee-c59d2141f6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:13.007567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdf381-bf98-4ab1-84d9-83c19f5a91f6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:13.043895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd3a5b-9aa9-4b42-bf9a-8308542c9cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:13.044820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd3a5b-9aa9-4b42-bf9a-8308542c9cc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:13.045213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd3a5b-9aa9-4b42-bf9a-8308542c9cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:13.045493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd3a5b-9aa9-4b42-bf9a-8308542c9cc3 None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/efdfb91ba4c04452ba547baa184185c4/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:13.047608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd3a5b-9aa9-4b42-bf9a-8308542c9cc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=efdfb91ba4c04452ba547baa184185c4, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:13.049092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd3a5b-9aa9-4b42-bf9a-8308542c9cc3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:13.050952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 390/777] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:13.052063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c62f-37a5-4d84-91ee-c59d2141f6d9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:13.083461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 388/778] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:18:12 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/efdfb91ba4c04452ba547baa184185c4/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:18:13.084308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd3a5b-9aa9-4b42-bf9a-8308542c9cc3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:13.113736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:13.176363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9c62f-37a5-4d84-91ee-c59d2141f6d9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:13.217812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9be1-21a9-416e-9e14-e457b6e21b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:13.218507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9be1-21a9-416e-9e14-e457b6e21b74 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:13.218792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9be1-21a9-416e-9e14-e457b6e21b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:13.219125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e9be1-21a9-416e-9e14-e457b6e21b74 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:13.219854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e9be1-21a9-416e-9e14-e457b6e21b74 None admin] RBAC: Adding query filter params (name=network) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:13.220165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e9be1-21a9-416e-9e14-e457b6e21b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:13.222257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e9be1-21a9-416e-9e14-e457b6e21b74 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:13.227801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 391/779] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:13.233725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9be1-21a9-416e-9e14-e457b6e21b74 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:13.310025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:13.353235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e9be1-21a9-416e-9e14-e457b6e21b74 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:13.372614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd3a5b-9aa9-4b42-bf9a-8308542c9cc3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:13.377573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:13.400976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669b468-f1e8-49e0-9ca5-c50a40b456c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:13.401648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b468-f1e8-49e0-9ca5-c50a40b456c6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:13.401928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b468-f1e8-49e0-9ca5-c50a40b456c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:13.402197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b468-f1e8-49e0-9ca5-c50a40b456c6 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:13.403155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669b468-f1e8-49e0-9ca5-c50a40b456c6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:13.403514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669b468-f1e8-49e0-9ca5-c50a40b456c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:13.405113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669b468-f1e8-49e0-9ca5-c50a40b456c6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:13.414678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 392/780] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:13.414678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649ffcf-0a5e-4af9-9dc9-cafda9e1fa24 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:13.414678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649ffcf-0a5e-4af9-9dc9-cafda9e1fa24 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:13.414678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649ffcf-0a5e-4af9-9dc9-cafda9e1fa24 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:13.414678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 393/781] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:13.417836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649ffcf-0a5e-4af9-9dc9-cafda9e1fa24 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:13.421093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca07c9-fa23-42d7-960a-a21365ca3135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:13.423308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca07c9-fa23-42d7-960a-a21365ca3135 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:13.423806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca07c9-fa23-42d7-960a-a21365ca3135 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:13.424257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca07c9-fa23-42d7-960a-a21365ca3135 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:13.438409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca07c9-fa23-42d7-960a-a21365ca3135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-16ca07c9-fa23-42d7-960a-a21365ca3135 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:13.449513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:13.450678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:18:13.451710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:13.455043 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 389/782] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:18:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:13.456524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121facc9-70f2-4430-bb26-73d3493f7c89 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:13.456978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121facc9-70f2-4430-bb26-73d3493f7c89 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:13.457396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121facc9-70f2-4430-bb26-73d3493f7c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:13.479179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-121facc9-70f2-4430-bb26-73d3493f7c89 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:13.482034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-121facc9-70f2-4430-bb26-73d3493f7c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:13.539958 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649ffcf-0a5e-4af9-9dc9-cafda9e1fa24 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:13.573007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 390/783] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:13.574578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121facc9-70f2-4430-bb26-73d3493f7c89 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:13.576591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6367f-e157-4a8d-8e46-a7fd7c289784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:13.577314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6367f-e157-4a8d-8e46-a7fd7c289784 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:13.577595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6367f-e157-4a8d-8e46-a7fd7c289784 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:13.577898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6367f-e157-4a8d-8e46-a7fd7c289784 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:13.578767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6367f-e157-4a8d-8e46-a7fd7c289784 None admin] RBAC: Adding query filter params (interface=public, service_id=f26af18445c94b0ca1df2b6fcb7a0f97, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:13.579080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6367f-e157-4a8d-8e46-a7fd7c289784 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:13.580580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6367f-e157-4a8d-8e46-a7fd7c289784 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:13.586454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 394/784] 10.222.0.59 () {56 vars in 1251 bytes} [Fri Jul 1 16:18:13 2022] GET /identity/v3/endpoints?service_id=f26af18445c94b0ca1df2b6fcb7a0f97&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:13.591780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6367f-e157-4a8d-8e46-a7fd7c289784 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:13.641762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:13.643089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:13.694955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121facc9-70f2-4430-bb26-73d3493f7c89 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:13.702819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6367f-e157-4a8d-8e46-a7fd7c289784 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:13.742425 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3af7-1d22-410e-987e-74e83e0180a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:13.743556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3af7-1d22-410e-987e-74e83e0180a0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:13.743921 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3af7-1d22-410e-987e-74e83e0180a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:13.744280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3af7-1d22-410e-987e-74e83e0180a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:13.745188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b3af7-1d22-410e-987e-74e83e0180a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:13.748218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b3af7-1d22-410e-987e-74e83e0180a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:13.748218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b3af7-1d22-410e-987e-74e83e0180a0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:13.760319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc69d4-e2fd-4be6-8e98-d06da78c2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:13.761044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 391/785] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:18:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:13.762058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3af7-1d22-410e-987e-74e83e0180a0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:13.766610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc69d4-e2fd-4be6-8e98-d06da78c2a9a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:13.766610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc69d4-e2fd-4be6-8e98-d06da78c2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:13.766862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc69d4-e2fd-4be6-8e98-d06da78c2a9a None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:13.767628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc69d4-e2fd-4be6-8e98-d06da78c2a9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:13.769173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc69d4-e2fd-4be6-8e98-d06da78c2a9a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:13.781388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 395/786] 10.222.0.59 () {56 vars in 1087 bytes} [Fri Jul 1 16:18:13 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:13.781388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc69d4-e2fd-4be6-8e98-d06da78c2a9a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:13.960223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b3af7-1d22-410e-987e-74e83e0180a0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:13.985586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc69d4-e2fd-4be6-8e98-d06da78c2a9a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:13.986151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:14.000135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:14.022332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cb1fd-9e04-4823-bba6-2a578a873d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:14.023378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cb1fd-9e04-4823-bba6-2a578a873d83 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.023800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cb1fd-9e04-4823-bba6-2a578a873d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.024231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8cb1fd-9e04-4823-bba6-2a578a873d83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.028977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987fc66-4104-40aa-8b87-9d66e92d5512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:14.029888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987fc66-4104-40aa-8b87-9d66e92d5512 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.030256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987fc66-4104-40aa-8b87-9d66e92d5512 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.030614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987fc66-4104-40aa-8b87-9d66e92d5512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.041700 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8cb1fd-9e04-4823-bba6-2a578a873d83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:14.046574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987fc66-4104-40aa-8b87-9d66e92d5512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:14.048188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987fc66-4104-40aa-8b87-9d66e92d5512 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-7a8cb1fd-9e04-4823-bba6-2a578a873d83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:14.051626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:14.053125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:14.054152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:14.055756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 392/787] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:14.063465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cb1fd-9e04-4823-bba6-2a578a873d83 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5987fc66-4104-40aa-8b87-9d66e92d5512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:14.071153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:14.072210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:14.073329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:14.073329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:14.073329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:14.073329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:14.074925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 396/788] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:14.086739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987fc66-4104-40aa-8b87-9d66e92d5512 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:14.205322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987fc66-4104-40aa-8b87-9d66e92d5512 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:14.215141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8cb1fd-9e04-4823-bba6-2a578a873d83 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:14.244530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a681d-40eb-4c45-9b09-8f5af839c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:14.245514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a681d-40eb-4c45-9b09-8f5af839c453 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.245887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a681d-40eb-4c45-9b09-8f5af839c453 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.246255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a681d-40eb-4c45-9b09-8f5af839c453 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.247483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a681d-40eb-4c45-9b09-8f5af839c453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:14.247903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a681d-40eb-4c45-9b09-8f5af839c453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:14.249416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a681d-40eb-4c45-9b09-8f5af839c453 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:14.274793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 397/789] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:14.280494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c277-c51a-48ac-8a52-7fa95cc4f133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:14.281210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c277-c51a-48ac-8a52-7fa95cc4f133 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.281493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c277-c51a-48ac-8a52-7fa95cc4f133 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.281769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c277-c51a-48ac-8a52-7fa95cc4f133 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.282827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9c277-c51a-48ac-8a52-7fa95cc4f133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:14.283137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9c277-c51a-48ac-8a52-7fa95cc4f133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:14.284526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9c277-c51a-48ac-8a52-7fa95cc4f133 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:14.285830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a681d-40eb-4c45-9b09-8f5af839c453 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:14.301871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 393/790] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:14.311123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c277-c51a-48ac-8a52-7fa95cc4f133 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:14.317417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:14.373304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:14.419546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a681d-40eb-4c45-9b09-8f5af839c453 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:14.457601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c277-c51a-48ac-8a52-7fa95cc4f133 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:14.495274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1bfec-b6d1-4aed-9226-b04e1b34fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:14.496008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1bfec-b6d1-4aed-9226-b04e1b34fa04 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.496320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1bfec-b6d1-4aed-9226-b04e1b34fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.496715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1bfec-b6d1-4aed-9226-b04e1b34fa04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.508619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1bfec-b6d1-4aed-9226-b04e1b34fa04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:14.510282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1bfec-b6d1-4aed-9226-b04e1b34fa04 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-d7c1bfec-b6d1-4aed-9226-b04e1b34fa04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:14.528075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:14.529257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:14.530872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:14.530872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:14.530872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:14.530872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:14.530872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 394/791] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:14.531991 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11e2a-4619-4602-808d-13ec9bef9b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:14.532540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11e2a-4619-4602-808d-13ec9bef9b5e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.532830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11e2a-4619-4602-808d-13ec9bef9b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.533169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de11e2a-4619-4602-808d-13ec9bef9b5e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.535057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1bfec-b6d1-4aed-9226-b04e1b34fa04 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:14.557800 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de11e2a-4619-4602-808d-13ec9bef9b5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:14.559690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de11e2a-4619-4602-808d-13ec9bef9b5e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4de11e2a-4619-4602-808d-13ec9bef9b5e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:14.588890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:14.589899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:14.590867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:14.593931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 398/792] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:18:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:14.600178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11e2a-4619-4602-808d-13ec9bef9b5e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:14.624091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:14.640722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1bfec-b6d1-4aed-9226-b04e1b34fa04 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:14.676803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d74c-a96c-422b-861d-dc7bf279b0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:14.677507 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d74c-a96c-422b-861d-dc7bf279b0ec None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.677791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d74c-a96c-422b-861d-dc7bf279b0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.678070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d74c-a96c-422b-861d-dc7bf279b0ec None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.678797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d74c-a96c-422b-861d-dc7bf279b0ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:14.679104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d74c-a96c-422b-861d-dc7bf279b0ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:14.681992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d74c-a96c-422b-861d-dc7bf279b0ec None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:14.693997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 395/793] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:14.703309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d74c-a96c-422b-861d-dc7bf279b0ec None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:14.810129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d74c-a96c-422b-861d-dc7bf279b0ec None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:14.810771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:14.849638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de11e2a-4619-4602-808d-13ec9bef9b5e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:14.849864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aac615-f312-4c5d-965b-1d3a4070dcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:14.850657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac615-f312-4c5d-965b-1d3a4070dcff None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.850937 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac615-f312-4c5d-965b-1d3a4070dcff None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.851488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac615-f312-4c5d-965b-1d3a4070dcff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.861439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aac615-f312-4c5d-965b-1d3a4070dcff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:14.862921 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aac615-f312-4c5d-965b-1d3a4070dcff None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-53aac615-f312-4c5d-965b-1d3a4070dcff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:14.879430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:14.880406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 396/794] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43820ee-24b2-4a28-abad-256c0bc6401e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.886416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43820ee-24b2-4a28-abad-256c0bc6401e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.887373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43820ee-24b2-4a28-abad-256c0bc6401e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.887373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 397/795] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:14.897818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43820ee-24b2-4a28-abad-256c0bc6401e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:14.897977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce00986-3c5c-4180-88ce-045652c4f2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:14.898670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce00986-3c5c-4180-88ce-045652c4f2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.899015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce00986-3c5c-4180-88ce-045652c4f2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.899351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce00986-3c5c-4180-88ce-045652c4f2c6 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.900255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce00986-3c5c-4180-88ce-045652c4f2c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:14.900623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce00986-3c5c-4180-88ce-045652c4f2c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:14.902198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce00986-3c5c-4180-88ce-045652c4f2c6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:14.911303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:14.928924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 399/796] 10.222.0.59 () {56 vars in 1149 bytes} [Fri Jul 1 16:18:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:14.930533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3693aa-b70e-4123-8778-acd0654fdd3b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:14.930980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3693aa-b70e-4123-8778-acd0654fdd3b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:14.931435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3693aa-b70e-4123-8778-acd0654fdd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:14.948684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7b3693aa-b70e-4123-8778-acd0654fdd3b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:14.950200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7b3693aa-b70e-4123-8778-acd0654fdd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:15.016250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43820ee-24b2-4a28-abad-256c0bc6401e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.026147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 400/797] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:15.027992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3693aa-b70e-4123-8778-acd0654fdd3b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.052744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540acbb-b362-4880-9766-3b9951a3b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.053584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540acbb-b362-4880-9766-3b9951a3b0dc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.053932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540acbb-b362-4880-9766-3b9951a3b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.054515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540acbb-b362-4880-9766-3b9951a3b0dc None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.055160 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540acbb-b362-4880-9766-3b9951a3b0dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:15.055528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540acbb-b362-4880-9766-3b9951a3b0dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.060954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540acbb-b362-4880-9766-3b9951a3b0dc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.082572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 398/798] 10.222.0.59 () {56 vars in 1135 bytes} [Fri Jul 1 16:18:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:15.087782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540acbb-b362-4880-9766-3b9951a3b0dc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.132575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:15.155419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:15.176386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3693aa-b70e-4123-8778-acd0654fdd3b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.195889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540acbb-b362-4880-9766-3b9951a3b0dc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.213737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d28458-5342-436f-b4df-e66e1000f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.215122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d28458-5342-436f-b4df-e66e1000f402 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.215632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d28458-5342-436f-b4df-e66e1000f402 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.216128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d28458-5342-436f-b4df-e66e1000f402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.231233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d28458-5342-436f-b4df-e66e1000f402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.232758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d28458-5342-436f-b4df-e66e1000f402 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.233415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ef961-36a0-4430-8eb1-fa1a5dc94fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.234496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ef961-36a0-4430-8eb1-fa1a5dc94fcb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.234980 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ef961-36a0-4430-8eb1-fa1a5dc94fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.235442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ef961-36a0-4430-8eb1-fa1a5dc94fcb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.236294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ef961-36a0-4430-8eb1-fa1a5dc94fcb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.237908 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ef961-36a0-4430-8eb1-fa1a5dc94fcb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-fd3ef961-36a0-4430-8eb1-fa1a5dc94fcb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:15.250951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:15.251988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 01 16:18:15.252942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-24d28458-5342-436f-b4df-e66e1000f402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:15.253742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:15.254539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:15.255409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:15.255409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:15.255409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:15.255409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:15.263022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 401/800] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:15.263022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d28458-5342-436f-b4df-e66e1000f402 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.263253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 399/800] 10.222.0.59 () {56 vars in 1129 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:15.263253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ef961-36a0-4430-8eb1-fa1a5dc94fcb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.381691 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d28458-5342-436f-b4df-e66e1000f402 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.385243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ef961-36a0-4430-8eb1-fa1a5dc94fcb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.408518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:15.413411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:15.423132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae5fef-13c5-4f53-9755-cc6ee5d8e1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.424146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5fef-13c5-4f53-9755-cc6ee5d8e1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.424622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5fef-13c5-4f53-9755-cc6ee5d8e1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.425128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5fef-13c5-4f53-9755-cc6ee5d8e1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.426208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5fef-13c5-4f53-9755-cc6ee5d8e1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:15.426818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5fef-13c5-4f53-9755-cc6ee5d8e1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.428342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1685b3d-e511-4f13-843c-3a5bd4d6f900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.428764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5fef-13c5-4f53-9755-cc6ee5d8e1a2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.429171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1685b3d-e511-4f13-843c-3a5bd4d6f900 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.429450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1685b3d-e511-4f13-843c-3a5bd4d6f900 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.429722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1685b3d-e511-4f13-843c-3a5bd4d6f900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.442825 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 400/801] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:15.444072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae5fef-13c5-4f53-9755-cc6ee5d8e1a2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.448247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1685b3d-e511-4f13-843c-3a5bd4d6f900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.449778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1685b3d-e511-4f13-843c-3a5bd4d6f900 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a1685b3d-e511-4f13-843c-3a5bd4d6f900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:15.473940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:15.474890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:15.475817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:15.475817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:15.475817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:15.475817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:15.475817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 402/802] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:15.476832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1685b3d-e511-4f13-843c-3a5bd4d6f900 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.556643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae5fef-13c5-4f53-9755-cc6ee5d8e1a2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.579484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1685b3d-e511-4f13-843c-3a5bd4d6f900 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.591467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122375c-189c-445b-8ab9-049dd4088154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.592139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122375c-189c-445b-8ab9-049dd4088154 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.592423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122375c-189c-445b-8ab9-049dd4088154 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.592698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122375c-189c-445b-8ab9-049dd4088154 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.593433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122375c-189c-445b-8ab9-049dd4088154 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:15.593744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122375c-189c-445b-8ab9-049dd4088154 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.595110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122375c-189c-445b-8ab9-049dd4088154 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.604235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 401/803] 10.222.0.59 () {56 vars in 1124 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:15.604235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494024d7-7935-44fa-a517-0018ba47d0cc None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.604235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494024d7-7935-44fa-a517-0018ba47d0cc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.604235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494024d7-7935-44fa-a517-0018ba47d0cc None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.604235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 402/804] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:15.604235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494024d7-7935-44fa-a517-0018ba47d0cc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.622304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96746909-fb6f-4108-9cd7-4482adeec92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.623115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96746909-fb6f-4108-9cd7-4482adeec92d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.623403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96746909-fb6f-4108-9cd7-4482adeec92d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.623680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96746909-fb6f-4108-9cd7-4482adeec92d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.630714 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96746909-fb6f-4108-9cd7-4482adeec92d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.632264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96746909-fb6f-4108-9cd7-4482adeec92d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-96746909-fb6f-4108-9cd7-4482adeec92d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:15.646980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:15.647870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:15.648781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:15.648781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:15.648781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:15.648781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:15.648781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:15.648781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:15.648781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:15.648781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:15.652869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 403/805] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:15.653739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96746909-fb6f-4108-9cd7-4482adeec92d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.664651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:15.686097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:15.716867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494024d7-7935-44fa-a517-0018ba47d0cc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.756032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec13746-9de5-4ecb-8220-0473aeadba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.756706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13746-9de5-4ecb-8220-0473aeadba5e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.757037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13746-9de5-4ecb-8220-0473aeadba5e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.757320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec13746-9de5-4ecb-8220-0473aeadba5e None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.758036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec13746-9de5-4ecb-8220-0473aeadba5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:15.758340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec13746-9de5-4ecb-8220-0473aeadba5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.759715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec13746-9de5-4ecb-8220-0473aeadba5e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.762960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96746909-fb6f-4108-9cd7-4482adeec92d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.771285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 403/806] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:15.772467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebf15d-c86b-429c-bccd-f8bbd81b413a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.772752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebf15d-c86b-429c-bccd-f8bbd81b413a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.773064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebf15d-c86b-429c-bccd-f8bbd81b413a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.790640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-19ebf15d-c86b-429c-bccd-f8bbd81b413a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:15.791938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-19ebf15d-c86b-429c-bccd-f8bbd81b413a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:15.803250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d75fa-15b8-4291-b8c5-6a2061623d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.803923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d75fa-15b8-4291-b8c5-6a2061623d84 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.804206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d75fa-15b8-4291-b8c5-6a2061623d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.804481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d75fa-15b8-4291-b8c5-6a2061623d84 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.805236 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d75fa-15b8-4291-b8c5-6a2061623d84 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:15.805541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d75fa-15b8-4291-b8c5-6a2061623d84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.806913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d75fa-15b8-4291-b8c5-6a2061623d84 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.812596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 404/807] 10.222.0.59 () {56 vars in 1124 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:15.813411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d75fa-15b8-4291-b8c5-6a2061623d84 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.871894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 404/808] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:15.872949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebf15d-c86b-429c-bccd-f8bbd81b413a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.916098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:15.921284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:15.928061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d75fa-15b8-4291-b8c5-6a2061623d84 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:15.962305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbe7ef-3a76-433a-a5d3-c08de11268de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:15.962968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe7ef-3a76-433a-a5d3-c08de11268de None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:15.963247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe7ef-3a76-433a-a5d3-c08de11268de None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:15.963512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbe7ef-3a76-433a-a5d3-c08de11268de None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:15.964289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbe7ef-3a76-433a-a5d3-c08de11268de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:15.964592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbe7ef-3a76-433a-a5d3-c08de11268de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:15.966371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbe7ef-3a76-433a-a5d3-c08de11268de None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:15.978667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 405/809] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:15.979434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbe7ef-3a76-433a-a5d3-c08de11268de None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:15.979889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebf15d-c86b-429c-bccd-f8bbd81b413a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:16.016710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac1b53-76b7-4653-a3df-fbc53a7bfe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:16.017800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac1b53-76b7-4653-a3df-fbc53a7bfe51 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.018080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac1b53-76b7-4653-a3df-fbc53a7bfe51 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.018352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac1b53-76b7-4653-a3df-fbc53a7bfe51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.025820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac1b53-76b7-4653-a3df-fbc53a7bfe51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:16.027293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac1b53-76b7-4653-a3df-fbc53a7bfe51 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a7ac1b53-76b7-4653-a3df-fbc53a7bfe51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:16.045082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:16.046121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:16.047000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:16.047000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:16.047000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:16.047000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:16.047000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:16.047000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:16.047000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:16.047000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:16.047000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 405/810] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:16.047488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac1b53-76b7-4653-a3df-fbc53a7bfe51 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:16.091988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbe7ef-3a76-433a-a5d3-c08de11268de None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:16.127432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee552-ac26-40cb-bf2a-2b355962af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:16.128100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee552-ac26-40cb-bf2a-2b355962af58 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.128389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee552-ac26-40cb-bf2a-2b355962af58 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.128662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eee552-ac26-40cb-bf2a-2b355962af58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.129432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eee552-ac26-40cb-bf2a-2b355962af58 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:16.130825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eee552-ac26-40cb-bf2a-2b355962af58 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:16.152189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac1b53-76b7-4653-a3df-fbc53a7bfe51 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:16.164888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 406/811] 10.222.0.59 () {60 vars in 1144 bytes} [Fri Jul 1 16:18:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:16.165113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:16.165239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee552-ac26-40cb-bf2a-2b355962af58 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:16.172136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:16.211678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f41e76-744a-4881-bbf1-e5b49ff77859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:16.212504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f41e76-744a-4881-bbf1-e5b49ff77859 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.212788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f41e76-744a-4881-bbf1-e5b49ff77859 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.213093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f41e76-744a-4881-bbf1-e5b49ff77859 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.225228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f41e76-744a-4881-bbf1-e5b49ff77859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-d0f41e76-744a-4881-bbf1-e5b49ff77859 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:16.233632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:16.234692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:16.235528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 406/812] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:16.236217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f41e76-744a-4881-bbf1-e5b49ff77859 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:16.276739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eee552-ac26-40cb-bf2a-2b355962af58 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:16.314762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e9492-da8a-4650-8cb4-f3abc1ac51fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:16.315667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9492-da8a-4650-8cb4-f3abc1ac51fb None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.315948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9492-da8a-4650-8cb4-f3abc1ac51fb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.316220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e9492-da8a-4650-8cb4-f3abc1ac51fb None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/437bdb7c923e483eb39f448c42e4e787/roles/9802e06a85874fc98135684e38cb3a41` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.334125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e9492-da8a-4650-8cb4-f3abc1ac51fb None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=437bdb7c923e483eb39f448c42e4e787, role_id=9802e06a85874fc98135684e38cb3a41)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:16.335609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e9492-da8a-4650-8cb4-f3abc1ac51fb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:16.350472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 407/813] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:18:16 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/437bdb7c923e483eb39f448c42e4e787/roles/9802e06a85874fc98135684e38cb3a41 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:18:16.351168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f41e76-744a-4881-bbf1-e5b49ff77859 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:16.351838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471213-1333-452d-b6f8-c98c554d3df5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.352129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471213-1333-452d-b6f8-c98c554d3df5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.352400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471213-1333-452d-b6f8-c98c554d3df5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.354026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 408/814] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:16.354795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf471213-1333-452d-b6f8-c98c554d3df5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:16.404512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8208e3-b69a-4c13-a6fd-d748c714fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:16.405239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8208e3-b69a-4c13-a6fd-d748c714fad7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.405521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8208e3-b69a-4c13-a6fd-d748c714fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.405796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8208e3-b69a-4c13-a6fd-d748c714fad7 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.406607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8208e3-b69a-4c13-a6fd-d748c714fad7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:16.406917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8208e3-b69a-4c13-a6fd-d748c714fad7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:16.408473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8208e3-b69a-4c13-a6fd-d748c714fad7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:16.427800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 407/815] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:16.429705 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ddb80-c684-4782-9c5d-d855fa6d772c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.429993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ddb80-c684-4782-9c5d-d855fa6d772c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.430270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ddb80-c684-4782-9c5d-d855fa6d772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.441940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:16.457832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9a6ddb80-c684-4782-9c5d-d855fa6d772c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:16.459091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9a6ddb80-c684-4782-9c5d-d855fa6d772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:16.478887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:16.494813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf471213-1333-452d-b6f8-c98c554d3df5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:16.536079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360580-fa8d-4aa8-b3c4-ec2631d40333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:16.536774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360580-fa8d-4aa8-b3c4-ec2631d40333 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.540309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360580-fa8d-4aa8-b3c4-ec2631d40333 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.540603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4360580-fa8d-4aa8-b3c4-ec2631d40333 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.541424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360580-fa8d-4aa8-b3c4-ec2631d40333 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:16.541734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360580-fa8d-4aa8-b3c4-ec2631d40333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:16.543153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4360580-fa8d-4aa8-b3c4-ec2631d40333 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:16.552078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 408/816] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:16.553205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 409/817] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:16.555006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ddb80-c684-4782-9c5d-d855fa6d772c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:16.559550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360580-fa8d-4aa8-b3c4-ec2631d40333 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:16.678963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4360580-fa8d-4aa8-b3c4-ec2631d40333 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:16.694025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ddb80-c684-4782-9c5d-d855fa6d772c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:16.707813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:16.722165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea43588-8c6a-42ff-b0a2-a710e143324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:16.723851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea43588-8c6a-42ff-b0a2-a710e143324c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.724313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea43588-8c6a-42ff-b0a2-a710e143324c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.725005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea43588-8c6a-42ff-b0a2-a710e143324c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.734354 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18126896-7cad-4e37-b95c-ba78101b5eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:16.735427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18126896-7cad-4e37-b95c-ba78101b5eb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.735766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18126896-7cad-4e37-b95c-ba78101b5eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.736100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18126896-7cad-4e37-b95c-ba78101b5eb8 None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/7db0ec167b464cfea43931cd3c6183e9/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.738291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18126896-7cad-4e37-b95c-ba78101b5eb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=7db0ec167b464cfea43931cd3c6183e9, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:16.739426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea43588-8c6a-42ff-b0a2-a710e143324c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:16.739795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18126896-7cad-4e37-b95c-ba78101b5eb8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:16.741268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea43588-8c6a-42ff-b0a2-a710e143324c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:16.757523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 409/818] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:18:16 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/7db0ec167b464cfea43931cd3c6183e9/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:18:16.758691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18126896-7cad-4e37-b95c-ba78101b5eb8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2ea43588-8c6a-42ff-b0a2-a710e143324c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:16.769191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:16.770400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:16.771433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:16.771433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:16.771433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:16.771433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:16.771433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 410/819] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:16.775638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:16.777281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea43588-8c6a-42ff-b0a2-a710e143324c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:16.878076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18126896-7cad-4e37-b95c-ba78101b5eb8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:16.916569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dbfa9-0e19-46ed-8f8d-144b007f0adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:16.917675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dbfa9-0e19-46ed-8f8d-144b007f0adf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:16.918143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dbfa9-0e19-46ed-8f8d-144b007f0adf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:16.918552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dbfa9-0e19-46ed-8f8d-144b007f0adf None admin] PATH_INFO: `/v3/services/network` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:16.919707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dbfa9-0e19-46ed-8f8d-144b007f0adf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:16.921441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dbfa9-0e19-46ed-8f8d-144b007f0adf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-fb5dbfa9-0e19-46ed-8f8d-144b007f0adf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:16.934301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:16.935778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 01 16:18:16.936914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:16.939582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 410/820] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:16 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:16.958549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dbfa9-0e19-46ed-8f8d-144b007f0adf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:17.102364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:17.104548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea43588-8c6a-42ff-b0a2-a710e143324c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:17.138240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dbfa9-0e19-46ed-8f8d-144b007f0adf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:17.149982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18399b17-5039-4dbc-a3f4-8fd082190ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:17.150667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18399b17-5039-4dbc-a3f4-8fd082190ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:17.150972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18399b17-5039-4dbc-a3f4-8fd082190ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:17.151686 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18399b17-5039-4dbc-a3f4-8fd082190ad4 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:17.152499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18399b17-5039-4dbc-a3f4-8fd082190ad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:17.152766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18399b17-5039-4dbc-a3f4-8fd082190ad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:17.154855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18399b17-5039-4dbc-a3f4-8fd082190ad4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:17.172919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 411/821] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:17.175999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18399b17-5039-4dbc-a3f4-8fd082190ad4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:17.191109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c84e-2439-44a8-9185-923d491d5f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:17.192702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c84e-2439-44a8-9185-923d491d5f06 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:17.193159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c84e-2439-44a8-9185-923d491d5f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:17.193889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4c84e-2439-44a8-9185-923d491d5f06 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:17.195038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c84e-2439-44a8-9185-923d491d5f06 None admin] RBAC: Adding query filter params (name=network) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:17.195493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c84e-2439-44a8-9185-923d491d5f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:17.197643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4c84e-2439-44a8-9185-923d491d5f06 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:17.208554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 411/822] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:17.210519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c84e-2439-44a8-9185-923d491d5f06 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:17.223609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:17.306669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18399b17-5039-4dbc-a3f4-8fd082190ad4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:17.347784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd6ac-a142-46c6-b808-ffd94502dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:17.349136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd6ac-a142-46c6-b808-ffd94502dc51 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:17.349879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd6ac-a142-46c6-b808-ffd94502dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:17.350355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efd6ac-a142-46c6-b808-ffd94502dc51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:17.362551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efd6ac-a142-46c6-b808-ffd94502dc51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:17.365261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efd6ac-a142-46c6-b808-ffd94502dc51 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:17.381539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4c84e-2439-44a8-9185-923d491d5f06 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-64efd6ac-a142-46c6-b808-ffd94502dc51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:17.390150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:17.391104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:17.392041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:17.412952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 412/823] 10.222.0.59 () {56 vars in 1093 bytes} [Fri Jul 1 16:18:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:17.431534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd6ac-a142-46c6-b808-ffd94502dc51 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:17.471736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c315e-f90d-4853-835f-aaa321bc51e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:17.472337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c315e-f90d-4853-835f-aaa321bc51e6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:17.472622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c315e-f90d-4853-835f-aaa321bc51e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:17.472922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c315e-f90d-4853-835f-aaa321bc51e6 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:17.473645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c315e-f90d-4853-835f-aaa321bc51e6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:17.473953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c315e-f90d-4853-835f-aaa321bc51e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:17.475339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c315e-f90d-4853-835f-aaa321bc51e6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:17.483195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:17.499540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 412/824] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:17.513885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c315e-f90d-4853-835f-aaa321bc51e6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:17.551320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efd6ac-a142-46c6-b808-ffd94502dc51 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:17.553397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:17.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe60d0b-e0dc-421f-9226-0c47dced0848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:17.593501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe60d0b-e0dc-421f-9226-0c47dced0848 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:17.594283 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe60d0b-e0dc-421f-9226-0c47dced0848 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:17.595043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe60d0b-e0dc-421f-9226-0c47dced0848 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:17.596085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe60d0b-e0dc-421f-9226-0c47dced0848 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:17.596594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe60d0b-e0dc-421f-9226-0c47dced0848 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:17.598419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe60d0b-e0dc-421f-9226-0c47dced0848 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:17.624073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 413/825] 10.222.0.59 () {56 vars in 1133 bytes} [Fri Jul 1 16:18:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:17.625992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe60d0b-e0dc-421f-9226-0c47dced0848 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:17.737076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe60d0b-e0dc-421f-9226-0c47dced0848 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:17.750465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c315e-f90d-4853-835f-aaa321bc51e6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:17.775720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20deac4-993d-4ec1-8460-2dfb05a02ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:17.776381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20deac4-993d-4ec1-8460-2dfb05a02ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:17.776668 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20deac4-993d-4ec1-8460-2dfb05a02ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:17.776971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20deac4-993d-4ec1-8460-2dfb05a02ab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:17.803758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:17.835162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ff061-855e-498f-86ca-eb13af41caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:17.835835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ff061-855e-498f-86ca-eb13af41caec None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:17.836114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ff061-855e-498f-86ca-eb13af41caec None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:17.836385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ff061-855e-498f-86ca-eb13af41caec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:17.837155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ff061-855e-498f-86ca-eb13af41caec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:17.838541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ff061-855e-498f-86ca-eb13af41caec None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:17.851552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20deac4-993d-4ec1-8460-2dfb05a02ab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:17.853297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20deac4-993d-4ec1-8460-2dfb05a02ab4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:17.891650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 413/826] 10.222.0.59 () {60 vars in 1144 bytes} [Fri Jul 1 16:18:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:17.978303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 414/827] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 16:18:17.980407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ff061-855e-498f-86ca-eb13af41caec None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:18.048900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:18.098548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ff061-855e-498f-86ca-eb13af41caec None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:18.134567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb1066-8483-44c3-b1bd-af706987c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:18.135395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb1066-8483-44c3-b1bd-af706987c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.135680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb1066-8483-44c3-b1bd-af706987c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.135960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb1066-8483-44c3-b1bd-af706987c6b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.147752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb1066-8483-44c3-b1bd-af706987c6b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:18.149297 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb1066-8483-44c3-b1bd-af706987c6b1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-9adb1066-8483-44c3-b1bd-af706987c6b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:18.168104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:18.169328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:18.170215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:18.170215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:18.170215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:18.170215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:18.173939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 414/828] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:18.175576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20deac4-993d-4ec1-8460-2dfb05a02ab4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:18.248679 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:18.296768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20deac4-993d-4ec1-8460-2dfb05a02ab4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:18.338715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bbb5-ea21-418d-9dbd-47bfd03bb3d1 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.339224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bbb5-ea21-418d-9dbd-47bfd03bb3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.339472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bbb5-ea21-418d-9dbd-47bfd03bb3d1 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.340282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc92f0-090e-49bc-ae8f-9ba8c9144cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:18.341160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc92f0-090e-49bc-ae8f-9ba8c9144cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.341264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 415/829] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:18:18.341463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc92f0-090e-49bc-ae8f-9ba8c9144cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.341715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc92f0-090e-49bc-ae8f-9ba8c9144cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.342452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc92f0-090e-49bc-ae8f-9ba8c9144cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:18.342756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc92f0-090e-49bc-ae8f-9ba8c9144cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:18.344158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc92f0-090e-49bc-ae8f-9ba8c9144cb7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:18.354585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36957ad8-5aee-4d0d-8dc8-9aef5b94f28d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.354922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36957ad8-5aee-4d0d-8dc8-9aef5b94f28d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.355146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36957ad8-5aee-4d0d-8dc8-9aef5b94f28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.359299 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 415/830] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:18.368093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc92f0-090e-49bc-ae8f-9ba8c9144cb7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:18.378287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-36957ad8-5aee-4d0d-8dc8-9aef5b94f28d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:18.380265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-36957ad8-5aee-4d0d-8dc8-9aef5b94f28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:18.468927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 416/831] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:18.491603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36957ad8-5aee-4d0d-8dc8-9aef5b94f28d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:18.509687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc92f0-090e-49bc-ae8f-9ba8c9144cb7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:18.526533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:18.531155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:18.559072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259f22b-3f63-489a-bd58-e5d4d4b61670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:18.560326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259f22b-3f63-489a-bd58-e5d4d4b61670 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.560702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259f22b-3f63-489a-bd58-e5d4d4b61670 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.561076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259f22b-3f63-489a-bd58-e5d4d4b61670 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.571115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259f22b-3f63-489a-bd58-e5d4d4b61670 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:18.572661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259f22b-3f63-489a-bd58-e5d4d4b61670 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f259f22b-3f63-489a-bd58-e5d4d4b61670 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:18.590268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:18.591472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:18.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:18.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:18.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:18.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:18.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:18.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:18.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:18.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:18.592431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 416/832] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:18.597293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259f22b-3f63-489a-bd58-e5d4d4b61670 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:18.609980 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36957ad8-5aee-4d0d-8dc8-9aef5b94f28d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:18.644717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310d24-c161-40c3-97c9-eb636cfc1d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:18.645654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310d24-c161-40c3-97c9-eb636cfc1d49 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.646002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310d24-c161-40c3-97c9-eb636cfc1d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.646365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310d24-c161-40c3-97c9-eb636cfc1d49 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.647095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d310d24-c161-40c3-97c9-eb636cfc1d49 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:18.648564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d310d24-c161-40c3-97c9-eb636cfc1d49 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4d310d24-c161-40c3-97c9-eb636cfc1d49 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:18.661039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:18.662033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:18.662857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 417/833] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:18:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:18.668820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310d24-c161-40c3-97c9-eb636cfc1d49 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:18.725641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259f22b-3f63-489a-bd58-e5d4d4b61670 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:18.770067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b5f12-6ff7-44f8-8079-7decd00288d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:18.770743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5f12-6ff7-44f8-8079-7decd00288d4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.771026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5f12-6ff7-44f8-8079-7decd00288d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.771495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b5f12-6ff7-44f8-8079-7decd00288d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.772352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5f12-6ff7-44f8-8079-7decd00288d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:18.772659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5f12-6ff7-44f8-8079-7decd00288d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:18.774160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b5f12-6ff7-44f8-8079-7decd00288d4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:18.790113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 417/834] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:18.790684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:18.792511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6719a8-adbb-49b7-a59b-23d77ee4462b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.792802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6719a8-adbb-49b7-a59b-23d77ee4462b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.793096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6719a8-adbb-49b7-a59b-23d77ee4462b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.794956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 418/835] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:18.798058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6719a8-adbb-49b7-a59b-23d77ee4462b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:18.799448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310d24-c161-40c3-97c9-eb636cfc1d49 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:18.838803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:18.841005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52b40b-b23d-4688-8b56-43f1496adcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:18.841596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52b40b-b23d-4688-8b56-43f1496adcad None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.841892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52b40b-b23d-4688-8b56-43f1496adcad None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.842464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52b40b-b23d-4688-8b56-43f1496adcad None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.844798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52b40b-b23d-4688-8b56-43f1496adcad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:18.845607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52b40b-b23d-4688-8b56-43f1496adcad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:18.846999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52b40b-b23d-4688-8b56-43f1496adcad None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:18.857017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 418/836] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:18:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:18.858445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bf201-7c5a-4949-97f4-45d7119733b6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.858961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bf201-7c5a-4949-97f4-45d7119733b6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.859246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bf201-7c5a-4949-97f4-45d7119733b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.876964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f19bf201-7c5a-4949-97f4-45d7119733b6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:18.878156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f19bf201-7c5a-4949-97f4-45d7119733b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:18.915786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6719a8-adbb-49b7-a59b-23d77ee4462b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:18.948042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 419/837] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:18.948926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bf201-7c5a-4949-97f4-45d7119733b6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:18.960715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42282196-6367-4df7-9c36-15fbc9e76298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:18.961518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282196-6367-4df7-9c36-15fbc9e76298 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:18.961877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282196-6367-4df7-9c36-15fbc9e76298 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:18.962259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42282196-6367-4df7-9c36-15fbc9e76298 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:18.963655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42282196-6367-4df7-9c36-15fbc9e76298 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=efdfb91ba4c04452ba547baa184185c4) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:18.964040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42282196-6367-4df7-9c36-15fbc9e76298 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:18.966427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42282196-6367-4df7-9c36-15fbc9e76298 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:18.974875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 419/838] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:18 2022] GET /identity/v3/role_assignments?user.id=efdfb91ba4c04452ba547baa184185c4&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=842af9e8967047df873d061df391e820 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:18.975847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42282196-6367-4df7-9c36-15fbc9e76298 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:19.062491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:19.073544 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bf201-7c5a-4949-97f4-45d7119733b6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:19.108145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:19.112360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42282196-6367-4df7-9c36-15fbc9e76298 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:19.125041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c2c8c-414a-4e63-8bdd-fdb28a5a1a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:19.127053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c2c8c-414a-4e63-8bdd-fdb28a5a1a89 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:19.127335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c2c8c-414a-4e63-8bdd-fdb28a5a1a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:19.130989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c2c8c-414a-4e63-8bdd-fdb28a5a1a89 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:19.130989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c2c8c-414a-4e63-8bdd-fdb28a5a1a89 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:19.130989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c2c8c-414a-4e63-8bdd-fdb28a5a1a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:19.131265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c2c8c-414a-4e63-8bdd-fdb28a5a1a89 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:19.144870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 420/839] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:18:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:19.173108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e12f68-7a66-443a-b4a8-3d5e06dd73bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:19.173950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e12f68-7a66-443a-b4a8-3d5e06dd73bc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:19.174298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e12f68-7a66-443a-b4a8-3d5e06dd73bc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:19.174625 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e12f68-7a66-443a-b4a8-3d5e06dd73bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:19.189731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e12f68-7a66-443a-b4a8-3d5e06dd73bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-70e12f68-7a66-443a-b4a8-3d5e06dd73bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:19.197805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:19.198815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:19.200191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 420/840] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:18:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:19.205804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c2c8c-414a-4e63-8bdd-fdb28a5a1a89 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:19.315454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c2c8c-414a-4e63-8bdd-fdb28a5a1a89 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:19.338934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e0a2-48e8-488b-b4c8-006dd1e88ab2 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:19.339283 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e0a2-48e8-488b-b4c8-006dd1e88ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:19.339493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33e0a2-48e8-488b-b4c8-006dd1e88ab2 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:19.341095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 421/841] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:19.346206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8c33-d874-4a73-aa87-4bcf99caa74d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:19.346494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8c33-d874-4a73-aa87-4bcf99caa74d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:19.346771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8c33-d874-4a73-aa87-4bcf99caa74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:19.361039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea04bd-51fd-4f70-b3d1-7c8325c6a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:19.361653 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea04bd-51fd-4f70-b3d1-7c8325c6a10d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:19.361922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea04bd-51fd-4f70-b3d1-7c8325c6a10d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:19.362200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea04bd-51fd-4f70-b3d1-7c8325c6a10d None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:19.362949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea04bd-51fd-4f70-b3d1-7c8325c6a10d None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:19.363257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea04bd-51fd-4f70-b3d1-7c8325c6a10d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:19.364652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea04bd-51fd-4f70-b3d1-7c8325c6a10d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:19.367163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-728c8c33-d874-4a73-aa87-4bcf99caa74d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:19.369353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-728c8c33-d874-4a73-aa87-4bcf99caa74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:19.373474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 421/842] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:18:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:19.378774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea04bd-51fd-4f70-b3d1-7c8325c6a10d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:19.405773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:19.442935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 422/843] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:19.467025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8c33-d874-4a73-aa87-4bcf99caa74d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:19.497118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea04bd-51fd-4f70-b3d1-7c8325c6a10d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:19.534694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7768b-8a19-4d61-b235-3001a37c3b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:19.535540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7768b-8a19-4d61-b235-3001a37c3b83 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:19.535822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7768b-8a19-4d61-b235-3001a37c3b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:19.536091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7768b-8a19-4d61-b235-3001a37c3b83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:19.561809 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:19.577551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8c33-d874-4a73-aa87-4bcf99caa74d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:19.616779 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f708-f336-4646-be77-ed0c5a004794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:19.617552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f708-f336-4646-be77-ed0c5a004794 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:19.617819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f708-f336-4646-be77-ed0c5a004794 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:19.618090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f708-f336-4646-be77-ed0c5a004794 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:19.633066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060f708-f336-4646-be77-ed0c5a004794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e060f708-f336-4646-be77-ed0c5a004794 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:19.640977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:19.642192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:19.643226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:19.647258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 423/844] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:19.648238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f708-f336-4646-be77-ed0c5a004794 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:19.680135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7768b-8a19-4d61-b235-3001a37c3b83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:19.682075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7768b-8a19-4d61-b235-3001a37c3b83 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-40a7768b-8a19-4d61-b235-3001a37c3b83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:19.703013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:19.704048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:19.705179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:19.705179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:19.705179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:19.705179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:19.707295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 422/845] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:19.712596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7768b-8a19-4d61-b235-3001a37c3b83 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:19.765841 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f708-f336-4646-be77-ed0c5a004794 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:19.806955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:19.810564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcb2da-5ec7-49a7-bd8d-b79995b5ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:19.811527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcb2da-5ec7-49a7-bd8d-b79995b5ac24 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:19.811804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcb2da-5ec7-49a7-bd8d-b79995b5ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:19.812072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcb2da-5ec7-49a7-bd8d-b79995b5ac24 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:19.812822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcb2da-5ec7-49a7-bd8d-b79995b5ac24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:19.813155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcb2da-5ec7-49a7-bd8d-b79995b5ac24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:19.814596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcb2da-5ec7-49a7-bd8d-b79995b5ac24 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:19.828096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 424/846] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:19.829034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcb2da-5ec7-49a7-bd8d-b79995b5ac24 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:19.844681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:19.845182 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7768b-8a19-4d61-b235-3001a37c3b83 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:19.883485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7ee0-c8e6-4205-8fdb-4e573981e8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:19.884107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7ee0-c8e6-4205-8fdb-4e573981e8dd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:19.884386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7ee0-c8e6-4205-8fdb-4e573981e8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:19.884656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7ee0-c8e6-4205-8fdb-4e573981e8dd None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:19.885471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7ee0-c8e6-4205-8fdb-4e573981e8dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:19.885793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7ee0-c8e6-4205-8fdb-4e573981e8dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:19.887258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7ee0-c8e6-4205-8fdb-4e573981e8dd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:19.906780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 423/847] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:19.907959 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7ee0-c8e6-4205-8fdb-4e573981e8dd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:19.963143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcb2da-5ec7-49a7-bd8d-b79995b5ac24 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:20.009963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7ee0-c8e6-4205-8fdb-4e573981e8dd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:20.010546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629efd94-db30-4b30-a4b7-244c7df5bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:20.011854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629efd94-db30-4b30-a4b7-244c7df5bf38 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:20.013311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629efd94-db30-4b30-a4b7-244c7df5bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:20.013802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629efd94-db30-4b30-a4b7-244c7df5bf38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:20.028899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629efd94-db30-4b30-a4b7-244c7df5bf38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:20.030367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629efd94-db30-4b30-a4b7-244c7df5bf38 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:20.046161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-629efd94-db30-4b30-a4b7-244c7df5bf38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:20.047957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:20.048831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:20.050164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:20.050164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:20.050164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:20.050164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:20.050164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 425/848] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:20.056504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629efd94-db30-4b30-a4b7-244c7df5bf38 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:20.060376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac870f42-8d1e-4558-86c4-645f6c44e532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:20.062290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac870f42-8d1e-4558-86c4-645f6c44e532 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:20.062640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac870f42-8d1e-4558-86c4-645f6c44e532 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:20.062987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac870f42-8d1e-4558-86c4-645f6c44e532 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:20.072897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac870f42-8d1e-4558-86c4-645f6c44e532 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:20.074695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac870f42-8d1e-4558-86c4-645f6c44e532 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ac870f42-8d1e-4558-86c4-645f6c44e532 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:20.095370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:20.096323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:20.097289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 424/849] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:18:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:20.106196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac870f42-8d1e-4558-86c4-645f6c44e532 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:20.132738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:20.182684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629efd94-db30-4b30-a4b7-244c7df5bf38 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:20.220016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f98e5-527a-4c9e-a598-bbef05a918c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:20.220885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f98e5-527a-4c9e-a598-bbef05a918c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:20.221152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f98e5-527a-4c9e-a598-bbef05a918c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:20.221429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f98e5-527a-4c9e-a598-bbef05a918c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:20.222164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f98e5-527a-4c9e-a598-bbef05a918c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:20.222827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f98e5-527a-4c9e-a598-bbef05a918c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:20.224505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f98e5-527a-4c9e-a598-bbef05a918c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:20.232937 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac870f42-8d1e-4558-86c4-645f6c44e532 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:20.245119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 426/850] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:20.246395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f98e5-527a-4c9e-a598-bbef05a918c1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:20.275064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57534dbb-2893-4b07-9f8f-edeb26ec7fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:20.275740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57534dbb-2893-4b07-9f8f-edeb26ec7fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:20.276022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57534dbb-2893-4b07-9f8f-edeb26ec7fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:20.276299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57534dbb-2893-4b07-9f8f-edeb26ec7fd8 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:20.277178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57534dbb-2893-4b07-9f8f-edeb26ec7fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:20.277475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57534dbb-2893-4b07-9f8f-edeb26ec7fd8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:20.278972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57534dbb-2893-4b07-9f8f-edeb26ec7fd8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:20.301149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 425/851] 10.222.0.59 () {56 vars in 1149 bytes} [Fri Jul 1 16:18:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:20.302557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57534dbb-2893-4b07-9f8f-edeb26ec7fd8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:20.362744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:20.379345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f98e5-527a-4c9e-a598-bbef05a918c1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:20.407617 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:20.423692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069be3d-dc58-4dcc-bca6-971dce94c716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:20.424566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069be3d-dc58-4dcc-bca6-971dce94c716 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:20.424880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069be3d-dc58-4dcc-bca6-971dce94c716 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:20.425162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069be3d-dc58-4dcc-bca6-971dce94c716 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:20.426056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57534dbb-2893-4b07-9f8f-edeb26ec7fd8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:20.433710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069be3d-dc58-4dcc-bca6-971dce94c716 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:20.435141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069be3d-dc58-4dcc-bca6-971dce94c716 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-8069be3d-dc58-4dcc-bca6-971dce94c716 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:20.453761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:20.454740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 01 16:18:20.455705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:20.456983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 427/852] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:20.460707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069be3d-dc58-4dcc-bca6-971dce94c716 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:20.471480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba21e7b-9d08-4ba9-850b-b104ccc73ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:20.472140 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba21e7b-9d08-4ba9-850b-b104ccc73ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:20.472419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba21e7b-9d08-4ba9-850b-b104ccc73ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:20.472698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba21e7b-9d08-4ba9-850b-b104ccc73ef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:20.558969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba21e7b-9d08-4ba9-850b-b104ccc73ef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:20.560514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba21e7b-9d08-4ba9-850b-b104ccc73ef1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:20.588472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069be3d-dc58-4dcc-bca6-971dce94c716 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:20.620141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:20.636625 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b938d-f59b-4775-b36e-78571f607247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:20.637392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b938d-f59b-4775-b36e-78571f607247 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:20.637711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b938d-f59b-4775-b36e-78571f607247 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:20.637972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b938d-f59b-4775-b36e-78571f607247 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:20.639462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b938d-f59b-4775-b36e-78571f607247 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:20.639775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b938d-f59b-4775-b36e-78571f607247 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:20.641246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b938d-f59b-4775-b36e-78571f607247 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:20.665117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 428/853] 10.222.0.59 () {56 vars in 1135 bytes} [Fri Jul 1 16:18:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:20.666020 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b938d-f59b-4775-b36e-78571f607247 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:20.680115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 426/854] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 16:18:20.687627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba21e7b-9d08-4ba9-850b-b104ccc73ef1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:20.713904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:20.778038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b938d-f59b-4775-b36e-78571f607247 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:20.799168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba21e7b-9d08-4ba9-850b-b104ccc73ef1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:20.814132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930ed8-e798-458e-b50f-2ae52b471ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:20.814794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930ed8-e798-458e-b50f-2ae52b471ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:20.815071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930ed8-e798-458e-b50f-2ae52b471ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:20.815349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930ed8-e798-458e-b50f-2ae52b471ee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:20.840229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59944f4-7d92-4597-b8ab-13ad55f6c833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:20.841598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59944f4-7d92-4597-b8ab-13ad55f6c833 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:20.841881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59944f4-7d92-4597-b8ab-13ad55f6c833 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:20.842152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59944f4-7d92-4597-b8ab-13ad55f6c833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:20.855284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59944f4-7d92-4597-b8ab-13ad55f6c833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:20.857969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59944f4-7d92-4597-b8ab-13ad55f6c833 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:20.867689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b59944f4-7d92-4597-b8ab-13ad55f6c833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:20.880979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:20.881926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:20.882829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:20.882829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:20.882829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:20.882829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:20.885001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 427/855] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:20.888291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59944f4-7d92-4597-b8ab-13ad55f6c833 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:20.903502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c930ed8-e798-458e-b50f-2ae52b471ee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:20.905317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c930ed8-e798-458e-b50f-2ae52b471ee1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:20.955410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:21.017574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59944f4-7d92-4597-b8ab-13ad55f6c833 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.036481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 429/856] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:18:21.037820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930ed8-e798-458e-b50f-2ae52b471ee1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.056068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7445a9-2a8b-4f65-95b6-16a7bb3d4aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.056933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7445a9-2a8b-4f65-95b6-16a7bb3d4aed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.057162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7445a9-2a8b-4f65-95b6-16a7bb3d4aed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.057435 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7445a9-2a8b-4f65-95b6-16a7bb3d4aed None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.058159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7445a9-2a8b-4f65-95b6-16a7bb3d4aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:21.058749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7445a9-2a8b-4f65-95b6-16a7bb3d4aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.060326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7445a9-2a8b-4f65-95b6-16a7bb3d4aed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.072975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 428/857] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:21.078474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7445a9-2a8b-4f65-95b6-16a7bb3d4aed None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.144438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930ed8-e798-458e-b50f-2ae52b471ee1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.146281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:21.182221 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c7572-671d-474c-8ecf-ba6c2f239e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.183010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7572-671d-474c-8ecf-ba6c2f239e83 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.183831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7572-671d-474c-8ecf-ba6c2f239e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.183831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7572-671d-474c-8ecf-ba6c2f239e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.192160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:21.195639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c7572-671d-474c-8ecf-ba6c2f239e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.197259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7445a9-2a8b-4f65-95b6-16a7bb3d4aed None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.197530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c7572-671d-474c-8ecf-ba6c2f239e83 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f58c7572-671d-474c-8ecf-ba6c2f239e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:21.215364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:21.216270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:21.217191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:21.217191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:21.217191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:21.217191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:21.217191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 430/858] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:21.218153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4417a3-f630-4742-8c66-fa96c2e2c404 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.218153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4417a3-f630-4742-8c66-fa96c2e2c404 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.218457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4417a3-f630-4742-8c66-fa96c2e2c404 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.219850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 431/859] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:21.224362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4417a3-f630-4742-8c66-fa96c2e2c404 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.242323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79642c-5a1a-49be-ac70-f704d64d74f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.243229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79642c-5a1a-49be-ac70-f704d64d74f8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.243711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79642c-5a1a-49be-ac70-f704d64d74f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.243930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79642c-5a1a-49be-ac70-f704d64d74f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.251023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79642c-5a1a-49be-ac70-f704d64d74f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.252710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79642c-5a1a-49be-ac70-f704d64d74f8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ef79642c-5a1a-49be-ac70-f704d64d74f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:21.269139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:21.270280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:21.271484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:21.271484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:21.271484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:21.271484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:21.271484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:21.271484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:21.271484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:21.271484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:21.272990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 429/860] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:21.275001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79c2bd-875a-408a-9160-1af4b66da95d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.275285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79c2bd-875a-408a-9160-1af4b66da95d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.275565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79c2bd-875a-408a-9160-1af4b66da95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.291646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bb79c2bd-875a-408a-9160-1af4b66da95d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:21.292873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bb79c2bd-875a-408a-9160-1af4b66da95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:21.328400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4417a3-f630-4742-8c66-fa96c2e2c404 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.368867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 430/861] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:21.368867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270f223-595f-4a07-85d9-7ba6d736df0d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.368867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270f223-595f-4a07-85d9-7ba6d736df0d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.368867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270f223-595f-4a07-85d9-7ba6d736df0d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.368867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 431/862] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:21.368867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270f223-595f-4a07-85d9-7ba6d736df0d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.369692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72af4-8dc8-42b9-ab12-1e720146cf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.369692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72af4-8dc8-42b9-ab12-1e720146cf34 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.369692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72af4-8dc8-42b9-ab12-1e720146cf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.369692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72af4-8dc8-42b9-ab12-1e720146cf34 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.369956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a72af4-8dc8-42b9-ab12-1e720146cf34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:21.369956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a72af4-8dc8-42b9-ab12-1e720146cf34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.369956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a72af4-8dc8-42b9-ab12-1e720146cf34 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.385731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 432/863] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:21.385731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3c919-2750-464d-bad4-3edf9bae7f76 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.385731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3c919-2750-464d-bad4-3edf9bae7f76 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.385731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3c919-2750-464d-bad4-3edf9bae7f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.401843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9af3c919-2750-464d-bad4-3edf9bae7f76 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:21.403050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9af3c919-2750-464d-bad4-3edf9bae7f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:21.418157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:21.450019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:21.468379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270f223-595f-4a07-85d9-7ba6d736df0d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.473545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 433/864] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:21.474388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3c919-2750-464d-bad4-3edf9bae7f76 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.504577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aba660-1297-46bb-8af9-43b61a099771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.505267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aba660-1297-46bb-8af9-43b61a099771 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.505545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aba660-1297-46bb-8af9-43b61a099771 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.505816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aba660-1297-46bb-8af9-43b61a099771 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.506604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aba660-1297-46bb-8af9-43b61a099771 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:21.506908 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aba660-1297-46bb-8af9-43b61a099771 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.508338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aba660-1297-46bb-8af9-43b61a099771 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.520003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 432/865] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:21.520808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aba660-1297-46bb-8af9-43b61a099771 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.578332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3c919-2750-464d-bad4-3edf9bae7f76 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.621879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9470afd-659c-4514-a885-1ed45c14fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.622696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9470afd-659c-4514-a885-1ed45c14fc03 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.622982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9470afd-659c-4514-a885-1ed45c14fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.623278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9470afd-659c-4514-a885-1ed45c14fc03 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.623920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9470afd-659c-4514-a885-1ed45c14fc03 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.625346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9470afd-659c-4514-a885-1ed45c14fc03 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.626052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aba660-1297-46bb-8af9-43b61a099771 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.636365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c9470afd-659c-4514-a885-1ed45c14fc03 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:21.637487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:21.638402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:21.639260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 434/866] 10.222.0.59 () {56 vars in 1132 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:21.640379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9470afd-659c-4514-a885-1ed45c14fc03 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.664541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605748fa-7c53-4302-ab5b-31dab0ea53b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.665364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605748fa-7c53-4302-ab5b-31dab0ea53b7 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.665648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605748fa-7c53-4302-ab5b-31dab0ea53b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.665919 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605748fa-7c53-4302-ab5b-31dab0ea53b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.672621 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605748fa-7c53-4302-ab5b-31dab0ea53b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.674100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605748fa-7c53-4302-ab5b-31dab0ea53b7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.685878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-605748fa-7c53-4302-ab5b-31dab0ea53b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:21.687832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:21.688706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 433/867] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:21.690009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605748fa-7c53-4302-ab5b-31dab0ea53b7 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.746159 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9470afd-659c-4514-a885-1ed45c14fc03 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.780002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd151-4f28-4f4c-b0de-5d5d0cb75a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.780671 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd151-4f28-4f4c-b0de-5d5d0cb75a04 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.780981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd151-4f28-4f4c-b0de-5d5d0cb75a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.781256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd151-4f28-4f4c-b0de-5d5d0cb75a04 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.781985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcd151-4f28-4f4c-b0de-5d5d0cb75a04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.783370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcd151-4f28-4f4c-b0de-5d5d0cb75a04 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.792158 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605748fa-7c53-4302-ab5b-31dab0ea53b7 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.799154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 435/868] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:18:21 2022] POST /identity/v3/services => generated 251 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:21.799947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd151-4f28-4f4c-b0de-5d5d0cb75a04 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.856789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2a5a-ee78-40f8-9373-b9ae345ecf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.859085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2a5a-ee78-40f8-9373-b9ae345ecf75 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.859618 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2a5a-ee78-40f8-9373-b9ae345ecf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.859889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2a5a-ee78-40f8-9373-b9ae345ecf75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.860962 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a2a5a-ee78-40f8-9373-b9ae345ecf75 None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=437bdb7c923e483eb39f448c42e4e787) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:21.861314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a2a5a-ee78-40f8-9373-b9ae345ecf75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.862712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a2a5a-ee78-40f8-9373-b9ae345ecf75 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.870144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 434/869] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/role_assignments?user.id=437bdb7c923e483eb39f448c42e4e787&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:21.882032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2a5a-ee78-40f8-9373-b9ae345ecf75 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:21.924200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:21.933835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd151-4f28-4f4c-b0de-5d5d0cb75a04 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:21.944047 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:21.984454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4387e-513d-4d37-a90c-405f9b10b5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:21.985197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4387e-513d-4d37-a90c-405f9b10b5ee None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:21.985482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4387e-513d-4d37-a90c-405f9b10b5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:21.985757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4387e-513d-4d37-a90c-405f9b10b5ee None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:21.986482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4387e-513d-4d37-a90c-405f9b10b5ee None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:21.986796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4387e-513d-4d37-a90c-405f9b10b5ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:21.988220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4387e-513d-4d37-a90c-405f9b10b5ee None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:21.994385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 436/870] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:21.999879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4387e-513d-4d37-a90c-405f9b10b5ee None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:22.031360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2a5a-ee78-40f8-9373-b9ae345ecf75 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:22.073577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d65b6-c0c6-49df-af70-aedc2739d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:22.074277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d65b6-c0c6-49df-af70-aedc2739d35d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:22.074537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d65b6-c0c6-49df-af70-aedc2739d35d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:22.074890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d65b6-c0c6-49df-af70-aedc2739d35d None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:22.075691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d65b6-c0c6-49df-af70-aedc2739d35d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:22.076002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d65b6-c0c6-49df-af70-aedc2739d35d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:22.078277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d65b6-c0c6-49df-af70-aedc2739d35d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:22.092053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 435/871] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:22.098196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d65b6-c0c6-49df-af70-aedc2739d35d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:22.130590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4387e-513d-4d37-a90c-405f9b10b5ee None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:22.175016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916d1fb-d320-4b24-ad33-a54bcfb2cc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:22.176159 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916d1fb-d320-4b24-ad33-a54bcfb2cc5f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:22.176630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916d1fb-d320-4b24-ad33-a54bcfb2cc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:22.177652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916d1fb-d320-4b24-ad33-a54bcfb2cc5f None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:22.179096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916d1fb-d320-4b24-ad33-a54bcfb2cc5f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:22.179595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916d1fb-d320-4b24-ad33-a54bcfb2cc5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:22.182721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916d1fb-d320-4b24-ad33-a54bcfb2cc5f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:22.192407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 437/872] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:22.206483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:22.217577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d65b6-c0c6-49df-af70-aedc2739d35d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:22.257927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd083f6-179c-4c75-97e1-5a5177d1e764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:22.258524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd083f6-179c-4c75-97e1-5a5177d1e764 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:22.258809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd083f6-179c-4c75-97e1-5a5177d1e764 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:22.259089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd083f6-179c-4c75-97e1-5a5177d1e764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:22.259940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd083f6-179c-4c75-97e1-5a5177d1e764 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=7db0ec167b464cfea43931cd3c6183e9) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:22.260259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd083f6-179c-4c75-97e1-5a5177d1e764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:22.261875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd083f6-179c-4c75-97e1-5a5177d1e764 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:22.269345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 436/873] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:22 2022] GET /identity/v3/role_assignments?user.id=7db0ec167b464cfea43931cd3c6183e9&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=842af9e8967047df873d061df391e820 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:23.887912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f1290-cd07-42ac-97a8-7ef566120d40 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:23.888442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f1290-cd07-42ac-97a8-7ef566120d40 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:23.888811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f1290-cd07-42ac-97a8-7ef566120d40 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:23.891915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 438/874] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:23.897390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59f0e3-9581-4813-9971-e4d7cf97602f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:23.897804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59f0e3-9581-4813-9971-e4d7cf97602f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:23.897947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59f0e3-9581-4813-9971-e4d7cf97602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:23.914933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-eb59f0e3-9581-4813-9971-e4d7cf97602f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:23.916123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-eb59f0e3-9581-4813-9971-e4d7cf97602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:23.983125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 437/875] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:23 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:24.005884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f1290-cd07-42ac-97a8-7ef566120d40 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.041660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:24.077675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16f688-e992-4c72-938e-27175c51f75f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.078118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16f688-e992-4c72-938e-27175c51f75f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.078494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16f688-e992-4c72-938e-27175c51f75f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.080218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 438/876] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:24.085401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404458-8d2b-406a-85d4-85be69993e04 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.085786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404458-8d2b-406a-85d4-85be69993e04 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.086158 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404458-8d2b-406a-85d4-85be69993e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.104198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-17404458-8d2b-406a-85d4-85be69993e04 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:24.106262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-17404458-8d2b-406a-85d4-85be69993e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:24.118770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f1290-cd07-42ac-97a8-7ef566120d40 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:24.158163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76713781-93c3-44bb-ad9d-7040cc8a78ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:24.159348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76713781-93c3-44bb-ad9d-7040cc8a78ba None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.159831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76713781-93c3-44bb-ad9d-7040cc8a78ba None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.160329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76713781-93c3-44bb-ad9d-7040cc8a78ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.161220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76713781-93c3-44bb-ad9d-7040cc8a78ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:24.162830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76713781-93c3-44bb-ad9d-7040cc8a78ba None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-76713781-93c3-44bb-ad9d-7040cc8a78ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:24.175638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:24.176672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 16:18:24.177564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:24.180429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 439/877] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:18:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:24.186276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76713781-93c3-44bb-ad9d-7040cc8a78ba None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.196891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 439/878] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:24.221402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404458-8d2b-406a-85d4-85be69993e04 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.243743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:24.289003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:24.293698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76713781-93c3-44bb-ad9d-7040cc8a78ba None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:24.327309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f4da4-abdc-49c3-9ef3-b9c60f0f9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:24.327980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f4da4-abdc-49c3-9ef3-b9c60f0f9b63 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.328265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f4da4-abdc-49c3-9ef3-b9c60f0f9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.328541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f4da4-abdc-49c3-9ef3-b9c60f0f9b63 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.329275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f4da4-abdc-49c3-9ef3-b9c60f0f9b63 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:24.329581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f4da4-abdc-49c3-9ef3-b9c60f0f9b63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:24.330961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f4da4-abdc-49c3-9ef3-b9c60f0f9b63 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:24.335527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 440/879] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:18:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:24.336740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bdd2f-6928-4122-9ad0-8cd96ab770fd None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.337301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bdd2f-6928-4122-9ad0-8cd96ab770fd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.337301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bdd2f-6928-4122-9ad0-8cd96ab770fd None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.338701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 441/880] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:24.339583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f06b1-8309-408a-853a-4790895693c8 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.340083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f06b1-8309-408a-853a-4790895693c8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.340207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f06b1-8309-408a-853a-4790895693c8 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.344885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 442/881] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:24.345047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404458-8d2b-406a-85d4-85be69993e04 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:24.345143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f06b1-8309-408a-853a-4790895693c8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.379687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a725aa9-1e5e-40da-9374-0f88f8416a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:24.380483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a725aa9-1e5e-40da-9374-0f88f8416a25 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.380763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a725aa9-1e5e-40da-9374-0f88f8416a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.381065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a725aa9-1e5e-40da-9374-0f88f8416a25 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.391481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a725aa9-1e5e-40da-9374-0f88f8416a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-0a725aa9-1e5e-40da-9374-0f88f8416a25 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:24.399677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:24.400604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 440/882] 10.222.0.59 () {56 vars in 1120 bytes} [Fri Jul 1 16:18:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:24.406595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6dda-ae61-4f89-ba90-1a045b5d4393 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.407348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6dda-ae61-4f89-ba90-1a045b5d4393 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.407348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf6dda-ae61-4f89-ba90-1a045b5d4393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.418515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-84bf6dda-ae61-4f89-ba90-1a045b5d4393 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:24.419721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-84bf6dda-ae61-4f89-ba90-1a045b5d4393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:24.450593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f06b1-8309-408a-853a-4790895693c8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:24.487957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 441/883] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:24.489392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e85ad7-8d52-4f81-8614-2888be29b1dd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.489761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e85ad7-8d52-4f81-8614-2888be29b1dd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.489965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e85ad7-8d52-4f81-8614-2888be29b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.490832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8d47f-c970-4f29-9037-01150317afab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:24.491547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8d47f-c970-4f29-9037-01150317afab None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.491788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8d47f-c970-4f29-9037-01150317afab None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.492050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8d47f-c970-4f29-9037-01150317afab None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.492776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8d47f-c970-4f29-9037-01150317afab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:24.493107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8d47f-c970-4f29-9037-01150317afab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:24.494493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8d47f-c970-4f29-9037-01150317afab None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:24.495702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:24.500516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 443/884] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:18:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:24.505698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8d47f-c970-4f29-9037-01150317afab None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.507117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-31e85ad7-8d52-4f81-8614-2888be29b1dd None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:24.508304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-31e85ad7-8d52-4f81-8614-2888be29b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:24.535430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:24.574570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 442/885] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:24.575335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e85ad7-8d52-4f81-8614-2888be29b1dd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.618413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8d47f-c970-4f29-9037-01150317afab None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:24.651295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21677-9f1d-415a-9b2a-5d7f110ba99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:24.651970 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21677-9f1d-415a-9b2a-5d7f110ba99a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.652253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21677-9f1d-415a-9b2a-5d7f110ba99a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.652519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa21677-9f1d-415a-9b2a-5d7f110ba99a None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.655170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa21677-9f1d-415a-9b2a-5d7f110ba99a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:24.655481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa21677-9f1d-415a-9b2a-5d7f110ba99a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:24.656897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa21677-9f1d-415a-9b2a-5d7f110ba99a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:24.665217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 444/886] 10.222.0.59 () {56 vars in 1115 bytes} [Fri Jul 1 16:18:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:24.666175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21677-9f1d-415a-9b2a-5d7f110ba99a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.673985 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e85ad7-8d52-4f81-8614-2888be29b1dd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:24.709565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762daea1-cb1c-4d9f-a49d-3c1134ec79cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:24.710266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762daea1-cb1c-4d9f-a49d-3c1134ec79cc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.710543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762daea1-cb1c-4d9f-a49d-3c1134ec79cc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.710798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762daea1-cb1c-4d9f-a49d-3c1134ec79cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.711585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762daea1-cb1c-4d9f-a49d-3c1134ec79cc None admin] RBAC: Adding query filter params (interface=public, service_id=ff5c09d2f73842afb655fa1d104b59fa, region_id=RegionOne) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:24.711894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762daea1-cb1c-4d9f-a49d-3c1134ec79cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:24.713310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762daea1-cb1c-4d9f-a49d-3c1134ec79cc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:24.715149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:24.721966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 443/887] 10.222.0.59 () {56 vars in 1251 bytes} [Fri Jul 1 16:18:24 2022] GET /identity/v3/endpoints?service_id=ff5c09d2f73842afb655fa1d104b59fa&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:24.722845 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762daea1-cb1c-4d9f-a49d-3c1134ec79cc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.760870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:24.773173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa21677-9f1d-415a-9b2a-5d7f110ba99a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:24.806726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c97cb4-cbb8-4010-a857-081947aad1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:24.807395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c97cb4-cbb8-4010-a857-081947aad1fd None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.807677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c97cb4-cbb8-4010-a857-081947aad1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.807954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c97cb4-cbb8-4010-a857-081947aad1fd None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.808689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c97cb4-cbb8-4010-a857-081947aad1fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:24.810232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c97cb4-cbb8-4010-a857-081947aad1fd None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:24.825163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 445/888] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:18:24 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:24.825911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c97cb4-cbb8-4010-a857-081947aad1fd None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.828359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762daea1-cb1c-4d9f-a49d-3c1134ec79cc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:24.875366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f855052-1677-469e-8ec6-732683f0dc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:24.876198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f855052-1677-469e-8ec6-732683f0dc6c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:24.876519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f855052-1677-469e-8ec6-732683f0dc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:24.876799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f855052-1677-469e-8ec6-732683f0dc6c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:24.877485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f855052-1677-469e-8ec6-732683f0dc6c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:24.878913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f855052-1677-469e-8ec6-732683f0dc6c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4f855052-1677-469e-8ec6-732683f0dc6c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:24.893151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:24.894420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:24.896879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 444/889] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:24.898814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f855052-1677-469e-8ec6-732683f0dc6c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:24.959610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c97cb4-cbb8-4010-a857-081947aad1fd None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:24.963868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:25.000932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054e5dc-a34f-48ad-a168-010c6fd02a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:25.001853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054e5dc-a34f-48ad-a168-010c6fd02a50 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:25.002118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054e5dc-a34f-48ad-a168-010c6fd02a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:25.002391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054e5dc-a34f-48ad-a168-010c6fd02a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:25.012414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f855052-1677-469e-8ec6-732683f0dc6c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:25.014520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054e5dc-a34f-48ad-a168-010c6fd02a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:25.015992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2054e5dc-a34f-48ad-a168-010c6fd02a50 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:25.025213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2054e5dc-a34f-48ad-a168-010c6fd02a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:25.035172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:25.036344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:25.037463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:25.037463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:25.037463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:25.037463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:25.041271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 446/890] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:25.042854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054e5dc-a34f-48ad-a168-010c6fd02a50 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:25.049886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cd5b1-cef4-4129-83b1-3cc7cb38bd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:25.050639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cd5b1-cef4-4129-83b1-3cc7cb38bd1e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:25.050992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cd5b1-cef4-4129-83b1-3cc7cb38bd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:25.051361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cd5b1-cef4-4129-83b1-3cc7cb38bd1e None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:25.052121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cd5b1-cef4-4129-83b1-3cc7cb38bd1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:25.053594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cd5b1-cef4-4129-83b1-3cc7cb38bd1e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:25.060173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 445/891] 10.222.0.59 () {56 vars in 1087 bytes} [Fri Jul 1 16:18:24 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:18:25.061182 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cd5b1-cef4-4129-83b1-3cc7cb38bd1e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:25.171864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054e5dc-a34f-48ad-a168-010c6fd02a50 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:25.221070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cd5b1-cef4-4129-83b1-3cc7cb38bd1e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:25.229989 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c7dc-379e-4285-a99d-5be024c15b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:25.231331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c7dc-379e-4285-a99d-5be024c15b60 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:25.231803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c7dc-379e-4285-a99d-5be024c15b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:25.232147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c7dc-379e-4285-a99d-5be024c15b60 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:25.234162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c7dc-379e-4285-a99d-5be024c15b60 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:25.234162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c7dc-379e-4285-a99d-5be024c15b60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:25.235374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c7dc-379e-4285-a99d-5be024c15b60 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:25.241958 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 447/892] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:25.247076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c7dc-379e-4285-a99d-5be024c15b60 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:25.253749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:25.273600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b799ed-6970-444d-b4da-d226b1d83084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:25.274654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b799ed-6970-444d-b4da-d226b1d83084 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:25.275196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b799ed-6970-444d-b4da-d226b1d83084 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:25.275564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b799ed-6970-444d-b4da-d226b1d83084 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:25.276571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b799ed-6970-444d-b4da-d226b1d83084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:25.277006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b799ed-6970-444d-b4da-d226b1d83084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:25.278727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b799ed-6970-444d-b4da-d226b1d83084 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:25.292128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 446/893] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:25.297795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b799ed-6970-444d-b4da-d226b1d83084 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:25.327292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:25.370626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c7dc-379e-4285-a99d-5be024c15b60 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:25.399182 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b799ed-6970-444d-b4da-d226b1d83084 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:25.407329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aaab2-849e-4b01-a638-3b474b5eb2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:25.408219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aaab2-849e-4b01-a638-3b474b5eb2df None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:25.408636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aaab2-849e-4b01-a638-3b474b5eb2df None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:25.409189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4aaab2-849e-4b01-a638-3b474b5eb2df None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:25.410024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4aaab2-849e-4b01-a638-3b474b5eb2df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:25.410479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4aaab2-849e-4b01-a638-3b474b5eb2df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:25.412087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4aaab2-849e-4b01-a638-3b474b5eb2df None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:25.417739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 448/894] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:25.444729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e922b-3f28-4c4e-9ea7-8ced931df5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:25.445903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e922b-3f28-4c4e-9ea7-8ced931df5df None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:25.446411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e922b-3f28-4c4e-9ea7-8ced931df5df None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:25.446837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e922b-3f28-4c4e-9ea7-8ced931df5df None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:25.455900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e922b-3f28-4c4e-9ea7-8ced931df5df None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:25.457763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e922b-3f28-4c4e-9ea7-8ced931df5df None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-538e922b-3f28-4c4e-9ea7-8ced931df5df None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:25.474667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:25.475881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:25.477054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:25.479620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 447/895] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:18:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:25.490133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aaab2-849e-4b01-a638-3b474b5eb2df None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:25.604012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4aaab2-849e-4b01-a638-3b474b5eb2df None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:25.631157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:25.640960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260e927-9890-441b-8884-bee300f81764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:25.641652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260e927-9890-441b-8884-bee300f81764 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:25.641934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260e927-9890-441b-8884-bee300f81764 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:25.642209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260e927-9890-441b-8884-bee300f81764 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:25.643054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260e927-9890-441b-8884-bee300f81764 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:25.643365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260e927-9890-441b-8884-bee300f81764 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:25.644827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260e927-9890-441b-8884-bee300f81764 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:25.662761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 449/896] 10.222.0.59 () {56 vars in 1149 bytes} [Fri Jul 1 16:18:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:25.668062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e922b-3f28-4c4e-9ea7-8ced931df5df None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:25.711938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:25.770977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e922b-3f28-4c4e-9ea7-8ced931df5df None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:25.805893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e31a79-35f2-4e86-86a6-977734bf5b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:25.806691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e31a79-35f2-4e86-86a6-977734bf5b3a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:25.807043 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e31a79-35f2-4e86-86a6-977734bf5b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:25.807385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e31a79-35f2-4e86-86a6-977734bf5b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:25.875626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e31a79-35f2-4e86-86a6-977734bf5b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:25.877219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e31a79-35f2-4e86-86a6-977734bf5b3a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:25.917833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:25.979313 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 448/897] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:25 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 16:18:25.985551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260e927-9890-441b-8884-bee300f81764 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:26.087664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260e927-9890-441b-8884-bee300f81764 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:26.122944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445cf8d-399e-4175-832f-27bc76bd3567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:26.123743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445cf8d-399e-4175-832f-27bc76bd3567 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:26.124013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445cf8d-399e-4175-832f-27bc76bd3567 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:26.124280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445cf8d-399e-4175-832f-27bc76bd3567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:26.134598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445cf8d-399e-4175-832f-27bc76bd3567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:26.136063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445cf8d-399e-4175-832f-27bc76bd3567 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f445cf8d-399e-4175-832f-27bc76bd3567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:26.153952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:26.155111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:26.156182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:26.156182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:26.156182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:26.156182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:26.156182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 450/898] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:26.160988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e31a79-35f2-4e86-86a6-977734bf5b3a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:26.265195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e31a79-35f2-4e86-86a6-977734bf5b3a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:26.299916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8adcd3-b48c-4564-b6a4-fd7bae93a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:26.300589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8adcd3-b48c-4564-b6a4-fd7bae93a327 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:26.300882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8adcd3-b48c-4564-b6a4-fd7bae93a327 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:26.301158 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8adcd3-b48c-4564-b6a4-fd7bae93a327 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:26.301870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8adcd3-b48c-4564-b6a4-fd7bae93a327 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:26.302172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8adcd3-b48c-4564-b6a4-fd7bae93a327 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:26.303530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8adcd3-b48c-4564-b6a4-fd7bae93a327 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:26.315721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 449/899] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:26.321223 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445cf8d-399e-4175-832f-27bc76bd3567 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:26.361937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:26.422047 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445cf8d-399e-4175-832f-27bc76bd3567 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:26.455749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdd556-0ccf-47b2-9e60-81d358d968c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:26.456547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdd556-0ccf-47b2-9e60-81d358d968c7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:26.456823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdd556-0ccf-47b2-9e60-81d358d968c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:26.457122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdd556-0ccf-47b2-9e60-81d358d968c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:26.463875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdd556-0ccf-47b2-9e60-81d358d968c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:26.465583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdd556-0ccf-47b2-9e60-81d358d968c7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-93fdd556-0ccf-47b2-9e60-81d358d968c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:26.479065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:26.479921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:26.481205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:26.481205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:26.481205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:26.481205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:26.481205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:26.481205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:26.481205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:26.481205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:26.485147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 451/900] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:26.487151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8adcd3-b48c-4564-b6a4-fd7bae93a327 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:26.491365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:26.593925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8adcd3-b48c-4564-b6a4-fd7bae93a327 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:26.631685 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44832dc9-0496-4d82-a9c6-0b08799db20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:26.632712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832dc9-0496-4d82-a9c6-0b08799db20c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:26.633272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832dc9-0496-4d82-a9c6-0b08799db20c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:26.633557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44832dc9-0496-4d82-a9c6-0b08799db20c None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:26.634366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44832dc9-0496-4d82-a9c6-0b08799db20c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:26.634667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44832dc9-0496-4d82-a9c6-0b08799db20c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:26.636118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44832dc9-0496-4d82-a9c6-0b08799db20c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:26.649335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 450/901] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:26.655567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdd556-0ccf-47b2-9e60-81d358d968c7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:26.757246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:26.761623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdd556-0ccf-47b2-9e60-81d358d968c7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:26.797734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b54ae-fc0e-4c5a-8dcf-c6797083100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:26.798424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b54ae-fc0e-4c5a-8dcf-c6797083100e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:26.798715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b54ae-fc0e-4c5a-8dcf-c6797083100e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:26.798983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b54ae-fc0e-4c5a-8dcf-c6797083100e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:26.799810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b54ae-fc0e-4c5a-8dcf-c6797083100e None admin] RBAC: Adding query filter params (role.id=f0bf50799b744d459a9f485d4c1f45b7, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=437bdb7c923e483eb39f448c42e4e787) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:26.800115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b54ae-fc0e-4c5a-8dcf-c6797083100e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:26.801575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b54ae-fc0e-4c5a-8dcf-c6797083100e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:26.807635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 452/902] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:26 2022] GET /identity/v3/role_assignments?user.id=437bdb7c923e483eb39f448c42e4e787&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=f0bf50799b744d459a9f485d4c1f45b7 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:26.912974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a678ee-9c6b-4285-baa3-db25e16a1298 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:26.913181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a678ee-9c6b-4285-baa3-db25e16a1298 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:26.913445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a678ee-9c6b-4285-baa3-db25e16a1298 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:26.915102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 451/903] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:26.920714 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0c64e-e0fb-4f31-8ba7-ef9bc38c017d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:26.921067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0c64e-e0fb-4f31-8ba7-ef9bc38c017d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:26.921319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0c64e-e0fb-4f31-8ba7-ef9bc38c017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:26.939511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-aef0c64e-e0fb-4f31-8ba7-ef9bc38c017d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:26.940746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aef0c64e-e0fb-4f31-8ba7-ef9bc38c017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:27.013593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 453/904] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:27.036327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a678ee-9c6b-4285-baa3-db25e16a1298 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:27.101170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:27.143759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a678ee-9c6b-4285-baa3-db25e16a1298 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:27.178843 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e62280-e186-4f2e-bbed-7379b7062cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:27.180043 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62280-e186-4f2e-bbed-7379b7062cbd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.180526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62280-e186-4f2e-bbed-7379b7062cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.181034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62280-e186-4f2e-bbed-7379b7062cbd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.181889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e62280-e186-4f2e-bbed-7379b7062cbd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:27.183459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e62280-e186-4f2e-bbed-7379b7062cbd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f0e62280-e186-4f2e-bbed-7379b7062cbd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:27.195894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:27.196875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 16:18:27.197723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:27.200672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 452/905] 10.222.0.59 () {56 vars in 1132 bytes} [Fri Jul 1 16:18:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:27.209015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0c64e-e0fb-4f31-8ba7-ef9bc38c017d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:27.239685 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100318-5209-4d52-b11b-ed87f9c83a29 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.240299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100318-5209-4d52-b11b-ed87f9c83a29 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.240813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af100318-5209-4d52-b11b-ed87f9c83a29 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.244181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 453/906] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:27.250899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff556fb-d8a5-4739-8347-76ada6f37fe3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.251185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff556fb-d8a5-4739-8347-76ada6f37fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.251516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff556fb-d8a5-4739-8347-76ada6f37fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.273202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9ff556fb-d8a5-4739-8347-76ada6f37fe3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:27.274567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9ff556fb-d8a5-4739-8347-76ada6f37fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:27.311337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:27.323436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0c64e-e0fb-4f31-8ba7-ef9bc38c017d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:27.364589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339091e-8b19-4edd-a523-41f1d9f62b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:27.365674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339091e-8b19-4edd-a523-41f1d9f62b29 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.366169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339091e-8b19-4edd-a523-41f1d9f62b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.366640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339091e-8b19-4edd-a523-41f1d9f62b29 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.367536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339091e-8b19-4edd-a523-41f1d9f62b29 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:27.368030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339091e-8b19-4edd-a523-41f1d9f62b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:27.369642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339091e-8b19-4edd-a523-41f1d9f62b29 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:27.371428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 454/907] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:27.377566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 454/908] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:27.381788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff556fb-d8a5-4739-8347-76ada6f37fe3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:27.395172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339091e-8b19-4edd-a523-41f1d9f62b29 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:27.442333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:27.489445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff556fb-d8a5-4739-8347-76ada6f37fe3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:27.507838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339091e-8b19-4edd-a523-41f1d9f62b29 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:27.526397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0f82-6a2d-4365-bccd-20e78c496a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:27.527196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0f82-6a2d-4365-bccd-20e78c496a30 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.527479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0f82-6a2d-4365-bccd-20e78c496a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.527824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae0f82-6a2d-4365-bccd-20e78c496a30 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.528537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae0f82-6a2d-4365-bccd-20e78c496a30 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:27.528991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae0f82-6a2d-4365-bccd-20e78c496a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:27.530355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae0f82-6a2d-4365-bccd-20e78c496a30 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:27.540339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 455/909] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:27.541439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0f82-6a2d-4365-bccd-20e78c496a30 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:27.554339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d9b4-e273-43a0-9c47-65c95187edd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:27.555166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d9b4-e273-43a0-9c47-65c95187edd8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.555786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d9b4-e273-43a0-9c47-65c95187edd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.556063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d9b4-e273-43a0-9c47-65c95187edd8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.557051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d9b4-e273-43a0-9c47-65c95187edd8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:27.558448 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d9b4-e273-43a0-9c47-65c95187edd8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-d6b1d9b4-e273-43a0-9c47-65c95187edd8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:27.570436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:27.571640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:27.572701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 455/910] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:18:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:27.573569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfddc81-06ac-4f6c-88eb-6d91e9434562 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.573569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfddc81-06ac-4f6c-88eb-6d91e9434562 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.573700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfddc81-06ac-4f6c-88eb-6d91e9434562 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.575082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 456/911] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:27.577378 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfddc81-06ac-4f6c-88eb-6d91e9434562 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:27.602544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:27.654995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae0f82-6a2d-4365-bccd-20e78c496a30 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:27.677734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:27.689786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfddc81-06ac-4f6c-88eb-6d91e9434562 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:27.693415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff880fb5-4c7b-4e66-91a9-a52175fcd698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:27.694080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880fb5-4c7b-4e66-91a9-a52175fcd698 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.694363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880fb5-4c7b-4e66-91a9-a52175fcd698 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.694637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff880fb5-4c7b-4e66-91a9-a52175fcd698 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.695429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880fb5-4c7b-4e66-91a9-a52175fcd698 None admin] RBAC: Adding query filter params (interface=public, service_id=0e156408233b44c4ade4a98cc0f6a24e, region_id=RegionOne) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:27.695736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880fb5-4c7b-4e66-91a9-a52175fcd698 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:27.697138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff880fb5-4c7b-4e66-91a9-a52175fcd698 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:27.703075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 456/912] 10.222.0.59 () {56 vars in 1251 bytes} [Fri Jul 1 16:18:27 2022] GET /identity/v3/endpoints?service_id=0e156408233b44c4ade4a98cc0f6a24e&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:27.704355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35377-79d8-4ed2-84f4-25bbbd851328 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.704639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35377-79d8-4ed2-84f4-25bbbd851328 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.704943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc35377-79d8-4ed2-84f4-25bbbd851328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.722920 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cbc35377-79d8-4ed2-84f4-25bbbd851328 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:27.724110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cbc35377-79d8-4ed2-84f4-25bbbd851328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:27.732660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601e82a-1f05-4dc9-9e18-d557e14dce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:27.733574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601e82a-1f05-4dc9-9e18-d557e14dce79 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.734035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601e82a-1f05-4dc9-9e18-d557e14dce79 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.734475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601e82a-1f05-4dc9-9e18-d557e14dce79 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.735333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601e82a-1f05-4dc9-9e18-d557e14dce79 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:27.735790 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601e82a-1f05-4dc9-9e18-d557e14dce79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:27.737210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601e82a-1f05-4dc9-9e18-d557e14dce79 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:27.747116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 457/913] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:18:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:27.748102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601e82a-1f05-4dc9-9e18-d557e14dce79 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:27.803470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 457/914] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:27.804563 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc35377-79d8-4ed2-84f4-25bbbd851328 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:27.846637 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:27.865007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601e82a-1f05-4dc9-9e18-d557e14dce79 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:27.902658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb4e4-1a97-44de-97d9-2124b9887334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:27.903330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb4e4-1a97-44de-97d9-2124b9887334 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.903608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb4e4-1a97-44de-97d9-2124b9887334 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.903878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb4e4-1a97-44de-97d9-2124b9887334 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.904560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eb4e4-1a97-44de-97d9-2124b9887334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:27.906095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eb4e4-1a97-44de-97d9-2124b9887334 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:27.920971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 458/915] 10.222.0.59 () {56 vars in 1087 bytes} [Fri Jul 1 16:18:27 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:18:27.920971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb4e4-1a97-44de-97d9-2124b9887334 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:27.926823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc35377-79d8-4ed2-84f4-25bbbd851328 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:27.945451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:27.975166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c8f33-cb03-43f3-90ca-029c8be79985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:27.976359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8f33-cb03-43f3-90ca-029c8be79985 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:27.976645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8f33-cb03-43f3-90ca-029c8be79985 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:27.976961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8f33-cb03-43f3-90ca-029c8be79985 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:27.977970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c8f33-cb03-43f3-90ca-029c8be79985 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:27.978341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c8f33-cb03-43f3-90ca-029c8be79985 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:27.981623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c8f33-cb03-43f3-90ca-029c8be79985 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:27.989828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 458/916] 10.222.0.59 () {56 vars in 1114 bytes} [Fri Jul 1 16:18:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:27.995852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c8f33-cb03-43f3-90ca-029c8be79985 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:28.043843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb4e4-1a97-44de-97d9-2124b9887334 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:28.083903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc2db3-c286-445e-b69d-b1db676ba08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:28.085133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc2db3-c286-445e-b69d-b1db676ba08b None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:28.085607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc2db3-c286-445e-b69d-b1db676ba08b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:28.086145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc2db3-c286-445e-b69d-b1db676ba08b None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:28.087083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc2db3-c286-445e-b69d-b1db676ba08b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:28.088905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc2db3-c286-445e-b69d-b1db676ba08b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:28.111572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c8f33-cb03-43f3-90ca-029c8be79985 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:28.114109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 459/917] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:18:27 2022] POST /identity/v3/services => generated 241 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:28.161502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e5dec-4159-47dc-a2d7-2c648d74e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:28.163332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e5dec-4159-47dc-a2d7-2c648d74e9c0 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:28.163332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e5dec-4159-47dc-a2d7-2c648d74e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:28.163332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e5dec-4159-47dc-a2d7-2c648d74e9c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:28.163592 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e5dec-4159-47dc-a2d7-2c648d74e9c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:28.164941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e5dec-4159-47dc-a2d7-2c648d74e9c0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:28.190352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 459/918] 10.222.0.59 () {60 vars in 1144 bytes} [Fri Jul 1 16:18:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:18:28.856498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a890f-9f25-4ee7-a5d0-8013218d2730 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:28.856837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a890f-9f25-4ee7-a5d0-8013218d2730 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:28.857103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a890f-9f25-4ee7-a5d0-8013218d2730 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:28.858758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 460/919] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:28.864115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89625b3f-ebfb-40fa-ae92-6333a05b4102 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:28.864413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89625b3f-ebfb-40fa-ae92-6333a05b4102 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:28.864693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89625b3f-ebfb-40fa-ae92-6333a05b4102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:28.887942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-89625b3f-ebfb-40fa-ae92-6333a05b4102 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:28.889290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-89625b3f-ebfb-40fa-ae92-6333a05b4102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:28.915083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:28.966632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 460/920] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:28.989175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a890f-9f25-4ee7-a5d0-8013218d2730 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:29.001052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:29.099356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a890f-9f25-4ee7-a5d0-8013218d2730 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:29.134431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80651dcc-6d5b-4cc0-89ec-c0ccd78f2d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:29.135530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80651dcc-6d5b-4cc0-89ec-c0ccd78f2d58 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:29.135961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80651dcc-6d5b-4cc0-89ec-c0ccd78f2d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:29.136585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80651dcc-6d5b-4cc0-89ec-c0ccd78f2d58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:29.149453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80651dcc-6d5b-4cc0-89ec-c0ccd78f2d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-80651dcc-6d5b-4cc0-89ec-c0ccd78f2d58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:29.158549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:29.159707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:29.160736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:29.163161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 461/921] 10.222.0.59 () {56 vars in 1120 bytes} [Fri Jul 1 16:18:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:29.169055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89625b3f-ebfb-40fa-ae92-6333a05b4102 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:29.274263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89625b3f-ebfb-40fa-ae92-6333a05b4102 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:29.310524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a11bf6-1440-437d-85c6-f3254563e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:29.311236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a11bf6-1440-437d-85c6-f3254563e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:29.311523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a11bf6-1440-437d-85c6-f3254563e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:29.311797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a11bf6-1440-437d-85c6-f3254563e9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:29.312585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a11bf6-1440-437d-85c6-f3254563e9a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:29.312928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a11bf6-1440-437d-85c6-f3254563e9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:29.314382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a11bf6-1440-437d-85c6-f3254563e9a8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:29.324245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 461/922] 10.222.0.59 () {56 vars in 1115 bytes} [Fri Jul 1 16:18:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:29.330068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80651dcc-6d5b-4cc0-89ec-c0ccd78f2d58 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:29.400007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:29.435488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80651dcc-6d5b-4cc0-89ec-c0ccd78f2d58 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:29.469857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413d45-122f-482f-b1a0-8931e298c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:29.470659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413d45-122f-482f-b1a0-8931e298c930 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:29.470942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413d45-122f-482f-b1a0-8931e298c930 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:29.471215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413d45-122f-482f-b1a0-8931e298c930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:29.481961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb413d45-122f-482f-b1a0-8931e298c930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:29.483590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb413d45-122f-482f-b1a0-8931e298c930 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-cb413d45-122f-482f-b1a0-8931e298c930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:29.502042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:29.502976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:29.503864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:29.503864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:29.503864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:29.503864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:29.503864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 462/923] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:29.509386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a11bf6-1440-437d-85c6-f3254563e9a8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:29.529817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:29.615764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a11bf6-1440-437d-85c6-f3254563e9a8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:29.649331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25914c-1d1b-4009-8175-7c061a7d6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:29.650000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25914c-1d1b-4009-8175-7c061a7d6076 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:29.650275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25914c-1d1b-4009-8175-7c061a7d6076 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:29.650543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25914c-1d1b-4009-8175-7c061a7d6076 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:29.651350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25914c-1d1b-4009-8175-7c061a7d6076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:29.651558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25914c-1d1b-4009-8175-7c061a7d6076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:29.653041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25914c-1d1b-4009-8175-7c061a7d6076 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:29.665479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 462/924] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:29.671088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413d45-122f-482f-b1a0-8931e298c930 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:29.786431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413d45-122f-482f-b1a0-8931e298c930 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:29.806992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:29.827986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07564a3-b2cc-44bd-af5d-e2da76d669fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:29.828820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07564a3-b2cc-44bd-af5d-e2da76d669fc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:29.829115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07564a3-b2cc-44bd-af5d-e2da76d669fc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:29.829380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07564a3-b2cc-44bd-af5d-e2da76d669fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:29.837349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07564a3-b2cc-44bd-af5d-e2da76d669fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:29.838813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07564a3-b2cc-44bd-af5d-e2da76d669fc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b07564a3-b2cc-44bd-af5d-e2da76d669fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:29.854226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:29.855721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:29.856727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:29.857291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 463/925] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:18:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:29.863805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25914c-1d1b-4009-8175-7c061a7d6076 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:29.944723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:29.968489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25914c-1d1b-4009-8175-7c061a7d6076 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:30.004065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e877cad-5db5-4c2f-af7d-7765f58739d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:30.005037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e877cad-5db5-4c2f-af7d-7765f58739d4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.005464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e877cad-5db5-4c2f-af7d-7765f58739d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.005900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e877cad-5db5-4c2f-af7d-7765f58739d4 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.006898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e877cad-5db5-4c2f-af7d-7765f58739d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:30.007422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e877cad-5db5-4c2f-af7d-7765f58739d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:30.009134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e877cad-5db5-4c2f-af7d-7765f58739d4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:30.027291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 463/926] 10.222.0.59 () {56 vars in 1149 bytes} [Fri Jul 1 16:18:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:30.033131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07564a3-b2cc-44bd-af5d-e2da76d669fc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.137693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07564a3-b2cc-44bd-af5d-e2da76d669fc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:30.173895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9a2c7-bb3f-4895-8d6a-5d39413ec0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:30.174702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a2c7-bb3f-4895-8d6a-5d39413ec0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.174977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a2c7-bb3f-4895-8d6a-5d39413ec0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.175247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9a2c7-bb3f-4895-8d6a-5d39413ec0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.178308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6614e-14f0-4145-ac3d-d378bdd3e6d0 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.179185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6614e-14f0-4145-ac3d-d378bdd3e6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.179661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6614e-14f0-4145-ac3d-d378bdd3e6d0 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.181493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 464/927] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:30.186957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a2c7-bb3f-4895-8d6a-5d39413ec0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:30.187533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598044f-5a51-43ed-914f-c2a924bca6bc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.188051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598044f-5a51-43ed-914f-c2a924bca6bc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.188442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b9a2c7-bb3f-4895-8d6a-5d39413ec0b9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:30.188727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598044f-5a51-43ed-914f-c2a924bca6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.206283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c598044f-5a51-43ed-914f-c2a924bca6bc None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-71b9a2c7-bb3f-4895-8d6a-5d39413ec0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:30.206718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:30.207588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:30.208473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:30.208473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:30.208473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:30.208473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:30.208473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 464/928] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:30.213802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c598044f-5a51-43ed-914f-c2a924bca6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:30.214274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9a2c7-bb3f-4895-8d6a-5d39413ec0b9 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.251698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:30.286230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 465/929] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:18:30.287890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fd2a6-dc15-40f6-b70a-cfb16c9abe3f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.288186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fd2a6-dc15-40f6-b70a-cfb16c9abe3f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.288465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fd2a6-dc15-40f6-b70a-cfb16c9abe3f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.289903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 466/930] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:30.294926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bdb70-6ecd-4b3e-a735-5d6f912d1a4d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.295211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bdb70-6ecd-4b3e-a735-5d6f912d1a4d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.295488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3bdb70-6ecd-4b3e-a735-5d6f912d1a4d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.296736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 467/931] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:30.297893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1e3c4-bf7f-47c1-95ff-23a75e272d28 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.298182 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1e3c4-bf7f-47c1-95ff-23a75e272d28 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.298458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1e3c4-bf7f-47c1-95ff-23a75e272d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.315275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f8b1e3c4-bf7f-47c1-95ff-23a75e272d28 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:30.316449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f8b1e3c4-bf7f-47c1-95ff-23a75e272d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:30.327859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9a2c7-bb3f-4895-8d6a-5d39413ec0b9 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:30.361501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0f454-20ca-4855-a3f7-d6713319018d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:30.362145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0f454-20ca-4855-a3f7-d6713319018d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.362447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0f454-20ca-4855-a3f7-d6713319018d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.362879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0f454-20ca-4855-a3f7-d6713319018d None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.363636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0f454-20ca-4855-a3f7-d6713319018d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:30.363937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0f454-20ca-4855-a3f7-d6713319018d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:30.365327 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb0f454-20ca-4855-a3f7-d6713319018d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:30.376838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:30.377436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 465/932] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:30.382317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782c35f-d6d0-4125-a69e-e0c414609567 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.382770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782c35f-d6d0-4125-a69e-e0c414609567 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.383127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782c35f-d6d0-4125-a69e-e0c414609567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.385134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 468/933] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:30.385954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1e3c4-bf7f-47c1-95ff-23a75e272d28 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.400028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5782c35f-d6d0-4125-a69e-e0c414609567 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:30.401172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5782c35f-d6d0-4125-a69e-e0c414609567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:30.468951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 466/934] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:30.469790 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782c35f-d6d0-4125-a69e-e0c414609567 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.487871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1e3c4-bf7f-47c1-95ff-23a75e272d28 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:30.494098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:30.521599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffeb66-2af7-4377-a73c-94870ca40fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:30.522405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffeb66-2af7-4377-a73c-94870ca40fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.522688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffeb66-2af7-4377-a73c-94870ca40fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.522955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffeb66-2af7-4377-a73c-94870ca40fe2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.523605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffeb66-2af7-4377-a73c-94870ca40fe2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:30.525006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffeb66-2af7-4377-a73c-94870ca40fe2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b1ffeb66-2af7-4377-a73c-94870ca40fe2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:30.536886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:30.538004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.541822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 469/935] 10.222.0.59 () {56 vars in 1132 bytes} [Fri Jul 1 16:18:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:30.542687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffeb66-2af7-4377-a73c-94870ca40fe2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.574995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782c35f-d6d0-4125-a69e-e0c414609567 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:30.596694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:30.609730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a3a0-5821-41a1-ba68-6938508e5d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:30.610531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a3a0-5821-41a1-ba68-6938508e5d95 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.610808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a3a0-5821-41a1-ba68-6938508e5d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.611078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4a3a0-5821-41a1-ba68-6938508e5d95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.618407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4a3a0-5821-41a1-ba68-6938508e5d95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:30.619874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4a3a0-5821-41a1-ba68-6938508e5d95 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-30b4a3a0-5821-41a1-ba68-6938508e5d95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:30.633630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:30.634560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 467/936] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:30.640588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a3a0-5821-41a1-ba68-6938508e5d95 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.641169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffeb66-2af7-4377-a73c-94870ca40fe2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:30.673071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:30.673657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.673942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.674222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.674928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:30.676378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:30.677775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING keystone.server.flask.common [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 01 16:18:30.697458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.sql.core [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 16:18:30.697458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 01 16:18:30.697458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [parameters: {'id': '5fabeb1a82b444eb9782ac81377e055d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 01 16:18:30.697458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80130) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5fabeb1a82b444eb9782ac81377e055d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5fabeb1a82b444eb9782ac81377e055d. Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 16:18:30.705681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 01 16:18:30.706571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application yield resource Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise self.value Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application session.commit() Jul 01 16:18:30.707520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.flush() Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application compat.raise_( Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 16:18:30.708406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 16:18:30.709641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 16:18:30.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [parameters: {'id': '5fabeb1a82b444eb9782ac81377e055d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.712802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:30.713930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5fabeb1a82b444eb9782ac81377e055d. Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 470/937] 10.222.0.59 () {60 vars in 1140 bytes} [Fri Jul 1 16:18:30 2022] POST /identity/v3/projects => generated 262 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:30.715119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.727229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:30.747741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4a3a0-5821-41a1-ba68-6938508e5d95 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:30.782026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ec694-1edd-4dd7-a05d-672fb8ac70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:30.782839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ec694-1edd-4dd7-a05d-672fb8ac70e0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.783113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ec694-1edd-4dd7-a05d-672fb8ac70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.783382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ec694-1edd-4dd7-a05d-672fb8ac70e0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.784041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ec694-1edd-4dd7-a05d-672fb8ac70e0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:30.785465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ec694-1edd-4dd7-a05d-672fb8ac70e0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-895ec694-1edd-4dd7-a05d-672fb8ac70e0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:30.798056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:30.799040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:30.799884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 468/938] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:30.800747 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ec694-1edd-4dd7-a05d-672fb8ac70e0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.813434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45190a5d-f715-45cd-9ab7-e739fc25fdfa None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:30.829419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:30.851439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a038223-ed21-4272-9071-0d17163845fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:30.852106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a038223-ed21-4272-9071-0d17163845fc None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.852386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a038223-ed21-4272-9071-0d17163845fc None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.852660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a038223-ed21-4272-9071-0d17163845fc None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.853414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a038223-ed21-4272-9071-0d17163845fc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:30.853718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a038223-ed21-4272-9071-0d17163845fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:30.855671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a038223-ed21-4272-9071-0d17163845fc None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:30.863239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 471/939] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:30.864015 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a038223-ed21-4272-9071-0d17163845fc None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.901910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ec694-1edd-4dd7-a05d-672fb8ac70e0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:30.935939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153cfcd-bb17-4af0-9275-13922243175b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:30.936524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153cfcd-bb17-4af0-9275-13922243175b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:30.936793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153cfcd-bb17-4af0-9275-13922243175b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:30.937114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153cfcd-bb17-4af0-9275-13922243175b None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:30.937903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153cfcd-bb17-4af0-9275-13922243175b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:30.938216 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153cfcd-bb17-4af0-9275-13922243175b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:30.939669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153cfcd-bb17-4af0-9275-13922243175b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:30.951575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 469/940] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:30.952371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153cfcd-bb17-4af0-9275-13922243175b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:30.960204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:30.967332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a038223-ed21-4272-9071-0d17163845fc None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:31.000239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8851dc3-c02e-4906-b1c8-ab16b9fd992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:31.001065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8851dc3-c02e-4906-b1c8-ab16b9fd992d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:31.001343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8851dc3-c02e-4906-b1c8-ab16b9fd992d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:31.001609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8851dc3-c02e-4906-b1c8-ab16b9fd992d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:31.008116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8851dc3-c02e-4906-b1c8-ab16b9fd992d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:31.009601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8851dc3-c02e-4906-b1c8-ab16b9fd992d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a8851dc3-c02e-4906-b1c8-ab16b9fd992d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:31.023630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:31.024559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:31.025475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:31.025475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:31.025475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:31.025475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:31.025475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:31.025475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:31.025475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:31.025475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:31.025475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 472/941] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:31.025948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8851dc3-c02e-4906-b1c8-ab16b9fd992d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:31.055784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153cfcd-bb17-4af0-9275-13922243175b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:31.066355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:31.090118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38070039-5f9a-49ae-9cf8-2640fad20d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:31.090789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38070039-5f9a-49ae-9cf8-2640fad20d76 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:31.091071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38070039-5f9a-49ae-9cf8-2640fad20d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:31.091342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38070039-5f9a-49ae-9cf8-2640fad20d76 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:31.092046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38070039-5f9a-49ae-9cf8-2640fad20d76 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:31.092354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38070039-5f9a-49ae-9cf8-2640fad20d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:31.093768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38070039-5f9a-49ae-9cf8-2640fad20d76 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:31.098469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 470/942] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:31.099231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38070039-5f9a-49ae-9cf8-2640fad20d76 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:31.126148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8851dc3-c02e-4906-b1c8-ab16b9fd992d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:31.160232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b9402-dc9c-4652-9109-e8f8baabb6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:31.160921 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9402-dc9c-4652-9109-e8f8baabb6bf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:31.161202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9402-dc9c-4652-9109-e8f8baabb6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:31.161477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b9402-dc9c-4652-9109-e8f8baabb6bf None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:31.162181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b9402-dc9c-4652-9109-e8f8baabb6bf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:31.162481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b9402-dc9c-4652-9109-e8f8baabb6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:31.163863 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b9402-dc9c-4652-9109-e8f8baabb6bf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:31.168649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 473/943] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:31.169474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b9402-dc9c-4652-9109-e8f8baabb6bf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:31.169925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:31.205192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38070039-5f9a-49ae-9cf8-2640fad20d76 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:31.239897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c133272-e7b7-4f42-a859-7322c92b3630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:31.240785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133272-e7b7-4f42-a859-7322c92b3630 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:31.241103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133272-e7b7-4f42-a859-7322c92b3630 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:31.241380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c133272-e7b7-4f42-a859-7322c92b3630 None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/437bdb7c923e483eb39f448c42e4e787/roles/f0bf50799b744d459a9f485d4c1f45b7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:31.243614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c133272-e7b7-4f42-a859-7322c92b3630 None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=437bdb7c923e483eb39f448c42e4e787, role_id=f0bf50799b744d459a9f485d4c1f45b7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:31.245094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c133272-e7b7-4f42-a859-7322c92b3630 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:31.260049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 471/944] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:18:31 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/437bdb7c923e483eb39f448c42e4e787/roles/f0bf50799b744d459a9f485d4c1f45b7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:18:31.261056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c133272-e7b7-4f42-a859-7322c92b3630 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:31.269324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b9402-dc9c-4652-9109-e8f8baabb6bf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:31.273657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:31.313343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1cb30-8008-4d4b-9859-2a29c746b9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:31.314119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1cb30-8008-4d4b-9859-2a29c746b9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:31.314300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1cb30-8008-4d4b-9859-2a29c746b9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:31.314592 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1cb30-8008-4d4b-9859-2a29c746b9d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:31.315358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1cb30-8008-4d4b-9859-2a29c746b9d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:31.315732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1cb30-8008-4d4b-9859-2a29c746b9d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:31.317464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1cb30-8008-4d4b-9859-2a29c746b9d8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:31.344893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 474/945] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:31.344893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1cb30-8008-4d4b-9859-2a29c746b9d8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:31.388877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c133272-e7b7-4f42-a859-7322c92b3630 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:31.423090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:31.432799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4859922-4bab-44a0-bcaa-80705797ec02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:31.433587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4859922-4bab-44a0-bcaa-80705797ec02 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:31.433904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4859922-4bab-44a0-bcaa-80705797ec02 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:31.434192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4859922-4bab-44a0-bcaa-80705797ec02 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:31.435172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4859922-4bab-44a0-bcaa-80705797ec02 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:31.435619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4859922-4bab-44a0-bcaa-80705797ec02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:31.437287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4859922-4bab-44a0-bcaa-80705797ec02 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:31.444424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 472/946] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:31.452659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4859922-4bab-44a0-bcaa-80705797ec02 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:31.468577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1cb30-8008-4d4b-9859-2a29c746b9d8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:31.516330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a1a24-d4d9-4677-a2b6-951eb6c76587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:31.517203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a1a24-d4d9-4677-a2b6-951eb6c76587 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:31.517617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a1a24-d4d9-4677-a2b6-951eb6c76587 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:31.518002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a1a24-d4d9-4677-a2b6-951eb6c76587 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:31.518854 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a1a24-d4d9-4677-a2b6-951eb6c76587 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:31.520380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a1a24-d4d9-4677-a2b6-951eb6c76587 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:31.551513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 475/947] 10.222.0.59 () {60 vars in 1144 bytes} [Fri Jul 1 16:18:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:31.577335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4859922-4bab-44a0-bcaa-80705797ec02 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:31.627146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88f826-8c80-47aa-93d7-f0951a0750a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:31.627832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f826-8c80-47aa-93d7-f0951a0750a2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:31.628112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f826-8c80-47aa-93d7-f0951a0750a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:31.628383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88f826-8c80-47aa-93d7-f0951a0750a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:31.629247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f826-8c80-47aa-93d7-f0951a0750a2 None admin] RBAC: Adding query filter params (interface=public, service_id=87e855f2a31a4dd58183cd37cc70a9f0, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:31.629558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f826-8c80-47aa-93d7-f0951a0750a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:31.630973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88f826-8c80-47aa-93d7-f0951a0750a2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:31.637521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 473/948] 10.222.0.59 () {56 vars in 1251 bytes} [Fri Jul 1 16:18:31 2022] GET /identity/v3/endpoints?service_id=87e855f2a31a4dd58183cd37cc70a9f0&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:31.644723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a1a24-d4d9-4677-a2b6-951eb6c76587 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:31.671831 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:31.773299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a1a24-d4d9-4677-a2b6-951eb6c76587 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:31.810773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4b0d0-38eb-424c-8d8c-406b2583716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:31.811445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b0d0-38eb-424c-8d8c-406b2583716e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:31.811774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b0d0-38eb-424c-8d8c-406b2583716e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:31.812055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4b0d0-38eb-424c-8d8c-406b2583716e None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:31.812746 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4b0d0-38eb-424c-8d8c-406b2583716e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:31.814167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4b0d0-38eb-424c-8d8c-406b2583716e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:31.821193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 476/949] 10.222.0.59 () {56 vars in 1087 bytes} [Fri Jul 1 16:18:31 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:18:33.349168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c606b-b7ef-4d9d-beb1-d0dcce828e5a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.349772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c606b-b7ef-4d9d-beb1-d0dcce828e5a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.349772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c606b-b7ef-4d9d-beb1-d0dcce828e5a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.351521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 474/950] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:33.357541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d333a-7cf5-4ff6-98bb-c26ea1f8fa41 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.358025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d333a-7cf5-4ff6-98bb-c26ea1f8fa41 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.358112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d333a-7cf5-4ff6-98bb-c26ea1f8fa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.375710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3a8d333a-7cf5-4ff6-98bb-c26ea1f8fa41 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:33.377241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3a8d333a-7cf5-4ff6-98bb-c26ea1f8fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:33.445219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 477/951] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:33.469346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c606b-b7ef-4d9d-beb1-d0dcce828e5a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:33.529883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:33.578043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c606b-b7ef-4d9d-beb1-d0dcce828e5a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:33.601131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d484c4-ff53-48d9-8f6f-e82859455cab None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.601317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d484c4-ff53-48d9-8f6f-e82859455cab None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.601593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d484c4-ff53-48d9-8f6f-e82859455cab None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.603225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 478/952] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:33.609008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe618e6-9e6c-426d-94f7-ac0da5e0274e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.609288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe618e6-9e6c-426d-94f7-ac0da5e0274e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.609560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe618e6-9e6c-426d-94f7-ac0da5e0274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.615882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3881875-6f78-4bfa-91cd-51dfbe9550bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:33.617048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3881875-6f78-4bfa-91cd-51dfbe9550bc None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.617565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3881875-6f78-4bfa-91cd-51dfbe9550bc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.618039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3881875-6f78-4bfa-91cd-51dfbe9550bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.626875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-dfe618e6-9e6c-426d-94f7-ac0da5e0274e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:33.628063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dfe618e6-9e6c-426d-94f7-ac0da5e0274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:33.629745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3881875-6f78-4bfa-91cd-51dfbe9550bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:33.638282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f3881875-6f78-4bfa-91cd-51dfbe9550bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:33.638456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:33.639395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:33.640287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 475/953] 10.222.0.59 () {56 vars in 1120 bytes} [Fri Jul 1 16:18:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:33.646940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3881875-6f78-4bfa-91cd-51dfbe9550bc None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:33.709020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 479/954] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:18:33.709486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc192c2-f12c-46a6-97f6-78bf71b0106a None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.709790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc192c2-f12c-46a6-97f6-78bf71b0106a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.710047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc192c2-f12c-46a6-97f6-78bf71b0106a None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.715892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 480/955] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:33.717225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b474f-2636-4f00-9ef0-11161c12e9f3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.717581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b474f-2636-4f00-9ef0-11161c12e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.717777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b474f-2636-4f00-9ef0-11161c12e9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.739161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c56b474f-2636-4f00-9ef0-11161c12e9f3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:33.740434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c56b474f-2636-4f00-9ef0-11161c12e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:33.761574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3881875-6f78-4bfa-91cd-51dfbe9550bc None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:33.776440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:33.798682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6c354-77ef-4680-9beb-d3b4b5d6712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:33.799374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6c354-77ef-4680-9beb-d3b4b5d6712a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.799654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6c354-77ef-4680-9beb-d3b4b5d6712a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.799929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6c354-77ef-4680-9beb-d3b4b5d6712a None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.801167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6c354-77ef-4680-9beb-d3b4b5d6712a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:33.801482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6c354-77ef-4680-9beb-d3b4b5d6712a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:33.802876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6c354-77ef-4680-9beb-d3b4b5d6712a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:33.814628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 481/956] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:33.815782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b474f-2636-4f00-9ef0-11161c12e9f3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:33.817455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 476/957] 10.222.0.59 () {56 vars in 1115 bytes} [Fri Jul 1 16:18:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:33.826333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6c354-77ef-4680-9beb-d3b4b5d6712a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:33.891966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:33.916924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b474f-2636-4f00-9ef0-11161c12e9f3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:33.937431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6c354-77ef-4680-9beb-d3b4b5d6712a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:33.950373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:33.951055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.951524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.951801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.952498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:33.954005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:33.967588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.sql.core [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 16:18:33.967588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 01 16:18:33.967588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [parameters: {'user_id': '3cef76c772c7452ba4217ac98607ca6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 01 16:18:33.967588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80130) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 01 16:18:33.972598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8993614-ff93-452a-bfa7-92679bd22761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:33.973423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8993614-ff93-452a-bfa7-92679bd22761 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:33.973702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8993614-ff93-452a-bfa7-92679bd22761 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:33.973973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8993614-ff93-452a-bfa7-92679bd22761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jul 01 16:18:33.975048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 16:18:33.976092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application yield resource Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application next(self.gen) Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.rollback() Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.force_reraise() Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise self.value Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application session.commit() Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 01 16:18:33.977363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._prepare_impl() Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.session.flush() Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._flush(objects) Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application compat.raise_( Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application flush_context.execute() Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rec.execute(self) Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 01 16:18:33.979522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 01 16:18:33.982570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result = self._query(query) Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application conn.query(q) Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application result.read() Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 01 16:18:33.983571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [parameters: {'user_id': '3cef76c772c7452ba4217ac98607ca6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:33.984628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 01 16:18:33.985692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 01 16:18:33.987360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 01 16:18:33.987360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 01 16:18:33.987360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 01 16:18:33.987360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 01 16:18:33.987360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 01 16:18:33.987360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:33.987360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 482/958] 10.222.0.59 () {60 vars in 1131 bytes} [Fri Jul 1 16:18:33 2022] POST /identity/v3/users => generated 160 bytes in 161 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:33.987360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:33.990530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8993614-ff93-452a-bfa7-92679bd22761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:33.992064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8993614-ff93-452a-bfa7-92679bd22761 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f8993614-ff93-452a-bfa7-92679bd22761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:34.009629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:34.010782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:34.012143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:34.012143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:34.012143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:34.012143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:34.012143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 477/959] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:34.013211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbfd97-c261-483c-b8d3-dc5852a1b084 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.013571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbfd97-c261-483c-b8d3-dc5852a1b084 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.013986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbfd97-c261-483c-b8d3-dc5852a1b084 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.016921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 478/960] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:34.016921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbfd97-c261-483c-b8d3-dc5852a1b084 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.044537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:34.079632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757780e-f820-4854-8dcd-d71238e00eee None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.113044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a8c5f-3d9c-452c-8c3e-58a096b27e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.113844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a8c5f-3d9c-452c-8c3e-58a096b27e57 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.114150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a8c5f-3d9c-452c-8c3e-58a096b27e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.114411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24a8c5f-3d9c-452c-8c3e-58a096b27e57 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.115064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a8c5f-3d9c-452c-8c3e-58a096b27e57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.116654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24a8c5f-3d9c-452c-8c3e-58a096b27e57 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.117835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbfd97-c261-483c-b8d3-dc5852a1b084 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.119312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b24a8c5f-3d9c-452c-8c3e-58a096b27e57 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:34.130090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:34.131348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 16:18:34.132384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:34.136394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 483/961] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:34.137322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a8c5f-3d9c-452c-8c3e-58a096b27e57 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.155832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b680a-71fb-40f6-801b-7bf61448f384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.156569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b680a-71fb-40f6-801b-7bf61448f384 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.156857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b680a-71fb-40f6-801b-7bf61448f384 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.157139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b680a-71fb-40f6-801b-7bf61448f384 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.164612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b680a-71fb-40f6-801b-7bf61448f384 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.166086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b680a-71fb-40f6-801b-7bf61448f384 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-e35b680a-71fb-40f6-801b-7bf61448f384 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:34.179852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:34.181021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:34.182145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 479/962] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:34.182760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89230-b1c7-4566-9cfb-543b23ab3ee3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.182760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89230-b1c7-4566-9cfb-543b23ab3ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.183018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc89230-b1c7-4566-9cfb-543b23ab3ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.199752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8cc89230-b1c7-4566-9cfb-543b23ab3ee3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:34.201010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8cc89230-b1c7-4566-9cfb-543b23ab3ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:34.242650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24a8c5f-3d9c-452c-8c3e-58a096b27e57 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.266948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 480/963] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:34.269033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89230-b1c7-4566-9cfb-543b23ab3ee3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.283032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e8654-d4c9-43d9-b35f-f3e2777e22a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.283703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8654-d4c9-43d9-b35f-f3e2777e22a0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.284134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8654-d4c9-43d9-b35f-f3e2777e22a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.284415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8654-d4c9-43d9-b35f-f3e2777e22a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.284870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:34.285653 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e8654-d4c9-43d9-b35f-f3e2777e22a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:34.285785 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e8654-d4c9-43d9-b35f-f3e2777e22a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.287133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e8654-d4c9-43d9-b35f-f3e2777e22a0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.302712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 484/964] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:34.303363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e8654-d4c9-43d9-b35f-f3e2777e22a0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.360915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:34.365269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc89230-b1c7-4566-9cfb-543b23ab3ee3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.398576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e8d92-dfd3-4a9a-a939-d1c810ea7d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.399243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e8d92-dfd3-4a9a-a939-d1c810ea7d54 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.399523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e8d92-dfd3-4a9a-a939-d1c810ea7d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.399796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e8d92-dfd3-4a9a-a939-d1c810ea7d54 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.400495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e8d92-dfd3-4a9a-a939-d1c810ea7d54 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:34.400600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e8654-d4c9-43d9-b35f-f3e2777e22a0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.400796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e8d92-dfd3-4a9a-a939-d1c810ea7d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.402340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e8d92-dfd3-4a9a-a939-d1c810ea7d54 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.407000 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 481/965] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:34.407715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e8d92-dfd3-4a9a-a939-d1c810ea7d54 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.435278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef459fb-ab34-4993-b1c7-599245a91105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.435988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef459fb-ab34-4993-b1c7-599245a91105 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.436269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef459fb-ab34-4993-b1c7-599245a91105 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.436546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef459fb-ab34-4993-b1c7-599245a91105 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.437391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef459fb-ab34-4993-b1c7-599245a91105 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:34.437802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef459fb-ab34-4993-b1c7-599245a91105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.439142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef459fb-ab34-4993-b1c7-599245a91105 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.476161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 485/966] 10.222.0.59 () {56 vars in 1101 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:34.477047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef459fb-ab34-4993-b1c7-599245a91105 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.507182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:34.535272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e8d92-dfd3-4a9a-a939-d1c810ea7d54 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.587695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3d78-5842-4633-82da-62283b3c8948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.589495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3d78-5842-4633-82da-62283b3c8948 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.589915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3d78-5842-4633-82da-62283b3c8948 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.590308 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b3d78-5842-4633-82da-62283b3c8948 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.591085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b3d78-5842-4633-82da-62283b3c8948 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.592619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b3d78-5842-4633-82da-62283b3c8948 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-1b2b3d78-5842-4633-82da-62283b3c8948 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:34.609853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:34.611186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:34.612494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 482/967] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:34.613529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3d78-5842-4633-82da-62283b3c8948 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.620032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef459fb-ab34-4993-b1c7-599245a91105 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.640157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:34.665814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb3f7-5ecb-4e10-a4a2-d84d7fa87093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.665814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb3f7-5ecb-4e10-a4a2-d84d7fa87093 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.665814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb3f7-5ecb-4e10-a4a2-d84d7fa87093 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.665814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb3f7-5ecb-4e10-a4a2-d84d7fa87093 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.675360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfb3f7-5ecb-4e10-a4a2-d84d7fa87093 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.676824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfb3f7-5ecb-4e10-a4a2-d84d7fa87093 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b8bfb3f7-5ecb-4e10-a4a2-d84d7fa87093 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:34.694499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:34.695688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 486/968] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:34.696947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb3f7-5ecb-4e10-a4a2-d84d7fa87093 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.749394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b3d78-5842-4633-82da-62283b3c8948 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.785871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008c6b1-9e5e-478d-968b-25f42d0c0858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.786541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008c6b1-9e5e-478d-968b-25f42d0c0858 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.786821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008c6b1-9e5e-478d-968b-25f42d0c0858 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.787093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008c6b1-9e5e-478d-968b-25f42d0c0858 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.787794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008c6b1-9e5e-478d-968b-25f42d0c0858 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:34.788100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008c6b1-9e5e-478d-968b-25f42d0c0858 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.789506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008c6b1-9e5e-478d-968b-25f42d0c0858 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.795943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 483/969] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:34.797142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008c6b1-9e5e-478d-968b-25f42d0c0858 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.808238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb3f7-5ecb-4e10-a4a2-d84d7fa87093 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.816537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:34.853188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b2e55-7528-4e3e-8b2d-ec19f89d901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.853883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b2e55-7528-4e3e-8b2d-ec19f89d901a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.854161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b2e55-7528-4e3e-8b2d-ec19f89d901a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.854434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b2e55-7528-4e3e-8b2d-ec19f89d901a None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.855648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b2e55-7528-4e3e-8b2d-ec19f89d901a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:34.855951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b2e55-7528-4e3e-8b2d-ec19f89d901a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.858076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b2e55-7528-4e3e-8b2d-ec19f89d901a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.869339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 487/970] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:34.870671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b2e55-7528-4e3e-8b2d-ec19f89d901a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:34.919983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:34.924137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008c6b1-9e5e-478d-968b-25f42d0c0858 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.971700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fb2c1-2a52-4dde-8160-86cc56a86534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:34.971700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fb2c1-2a52-4dde-8160-86cc56a86534 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:34.971700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fb2c1-2a52-4dde-8160-86cc56a86534 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:34.971700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fb2c1-2a52-4dde-8160-86cc56a86534 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:34.972175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fb2c1-2a52-4dde-8160-86cc56a86534 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:34.972323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fb2c1-2a52-4dde-8160-86cc56a86534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:34.973861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fb2c1-2a52-4dde-8160-86cc56a86534 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:34.990139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b2e55-7528-4e3e-8b2d-ec19f89d901a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:34.992574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 484/971] 10.222.0.59 () {56 vars in 1149 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:34.998333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fb2c1-2a52-4dde-8160-86cc56a86534 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:35.028860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bcba2-6255-4e35-8c8b-6ee8c3b1ce5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:35.029553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bcba2-6255-4e35-8c8b-6ee8c3b1ce5c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:35.029840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bcba2-6255-4e35-8c8b-6ee8c3b1ce5c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:35.030114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bcba2-6255-4e35-8c8b-6ee8c3b1ce5c None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:35.030835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bcba2-6255-4e35-8c8b-6ee8c3b1ce5c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:35.031142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bcba2-6255-4e35-8c8b-6ee8c3b1ce5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:35.032524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bcba2-6255-4e35-8c8b-6ee8c3b1ce5c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:35.042853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 488/972] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:35.044650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bcba2-6255-4e35-8c8b-6ee8c3b1ce5c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:35.071468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:35.109561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fb2c1-2a52-4dde-8160-86cc56a86534 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:35.148395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dd00d-a57e-498e-bb8c-da76703c90c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:35.149085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dd00d-a57e-498e-bb8c-da76703c90c4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:35.149366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dd00d-a57e-498e-bb8c-da76703c90c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:35.149636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9dd00d-a57e-498e-bb8c-da76703c90c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:35.149864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bcba2-6255-4e35-8c8b-6ee8c3b1ce5c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:35.158567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:35.187567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b96ce-adad-4d7c-bd0f-0c306567d3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:35.188149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b96ce-adad-4d7c-bd0f-0c306567d3a4 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:35.188430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b96ce-adad-4d7c-bd0f-0c306567d3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:35.188703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b96ce-adad-4d7c-bd0f-0c306567d3a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:35.189476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b96ce-adad-4d7c-bd0f-0c306567d3a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:35.190854 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b96ce-adad-4d7c-bd0f-0c306567d3a4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:35.214710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 489/973] 10.222.0.59 () {60 vars in 1144 bytes} [Fri Jul 1 16:18:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:18:35.232877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dd00d-a57e-498e-bb8c-da76703c90c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:35.234548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9dd00d-a57e-498e-bb8c-da76703c90c4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:35.313674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:35.353117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 485/974] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:34 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 16:18:35.359238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b96ce-adad-4d7c-bd0f-0c306567d3a4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:35.471673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b96ce-adad-4d7c-bd0f-0c306567d3a4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:35.508011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82973504-b317-4388-8836-bcd387b68740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:35.508815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82973504-b317-4388-8836-bcd387b68740 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:35.509228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82973504-b317-4388-8836-bcd387b68740 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:35.509500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82973504-b317-4388-8836-bcd387b68740 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:35.521718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82973504-b317-4388-8836-bcd387b68740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:35.523175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82973504-b317-4388-8836-bcd387b68740 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-82973504-b317-4388-8836-bcd387b68740 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:35.540738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:35.541832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:35.542860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:35.542860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:35.542860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:35.542860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:35.542860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 490/975] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:35.547590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dd00d-a57e-498e-bb8c-da76703c90c4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:35.648676 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9dd00d-a57e-498e-bb8c-da76703c90c4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:35.682600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e778-d9d0-4ffc-b067-b92314dcb8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:35.683273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e778-d9d0-4ffc-b067-b92314dcb8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:35.683574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e778-d9d0-4ffc-b067-b92314dcb8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:35.683885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82e778-d9d0-4ffc-b067-b92314dcb8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:35.684605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82e778-d9d0-4ffc-b067-b92314dcb8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:35.684939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82e778-d9d0-4ffc-b067-b92314dcb8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:35.686320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df82e778-d9d0-4ffc-b067-b92314dcb8f8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:35.698439 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 486/976] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:35.704062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82973504-b317-4388-8836-bcd387b68740 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:35.716968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:35.814976 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82973504-b317-4388-8836-bcd387b68740 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:35.849304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4023e-a99c-48db-a389-1e0139ca40b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:35.850595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4023e-a99c-48db-a389-1e0139ca40b5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:35.851106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4023e-a99c-48db-a389-1e0139ca40b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:35.851736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4023e-a99c-48db-a389-1e0139ca40b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:35.859797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4023e-a99c-48db-a389-1e0139ca40b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:35.861599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4023e-a99c-48db-a389-1e0139ca40b5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-40b4023e-a99c-48db-a389-1e0139ca40b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:35.876562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:35.877551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:35.878480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:35.878480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:35.878480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:35.878480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:35.878480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:35.878480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:35.878480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:35.878480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:35.881006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 491/977] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:35.884688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e778-d9d0-4ffc-b067-b92314dcb8f8 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:35.915469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:35.992326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82e778-d9d0-4ffc-b067-b92314dcb8f8 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:36.025664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e9d5b-7ed3-40a3-b03a-9fb00dbef0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:36.026329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e9d5b-7ed3-40a3-b03a-9fb00dbef0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:36.026612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e9d5b-7ed3-40a3-b03a-9fb00dbef0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:36.026884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e9d5b-7ed3-40a3-b03a-9fb00dbef0b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:36.027703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e9d5b-7ed3-40a3-b03a-9fb00dbef0b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:36.028006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e9d5b-7ed3-40a3-b03a-9fb00dbef0b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:36.029500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e9d5b-7ed3-40a3-b03a-9fb00dbef0b7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:36.048993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 487/978] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:36.054913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4023e-a99c-48db-a389-1e0139ca40b5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:36.126482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:36.157804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4023e-a99c-48db-a389-1e0139ca40b5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:36.193497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053248f-a521-4552-b49c-960167c0ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:36.194174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053248f-a521-4552-b49c-960167c0ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:36.194421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053248f-a521-4552-b49c-960167c0ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:36.194722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053248f-a521-4552-b49c-960167c0ffd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:36.195553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053248f-a521-4552-b49c-960167c0ffd8 None admin] RBAC: Adding query filter params (role.id=f0bf50799b744d459a9f485d4c1f45b7, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=437bdb7c923e483eb39f448c42e4e787) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:36.195866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053248f-a521-4552-b49c-960167c0ffd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:36.197337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053248f-a521-4552-b49c-960167c0ffd8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:36.203832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 492/979] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:36 2022] GET /identity/v3/role_assignments?user.id=437bdb7c923e483eb39f448c42e4e787&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=f0bf50799b744d459a9f485d4c1f45b7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:36.816008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c8152-ace6-4cc6-886d-87d9224f0329 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:36.816600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c8152-ace6-4cc6-886d-87d9224f0329 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:36.816600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c8152-ace6-4cc6-886d-87d9224f0329 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:36.818141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 488/980] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:36.823186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad062a-9a9a-4f6d-bdc5-1c278d40338e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:36.823597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad062a-9a9a-4f6d-bdc5-1c278d40338e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:36.823721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad062a-9a9a-4f6d-bdc5-1c278d40338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:36.843207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ddad062a-9a9a-4f6d-bdc5-1c278d40338e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:36.844759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ddad062a-9a9a-4f6d-bdc5-1c278d40338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:36.914313 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 493/981] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:18:36.936466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c8152-ace6-4cc6-886d-87d9224f0329 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:37.026691 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:37.041534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c8152-ace6-4cc6-886d-87d9224f0329 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:37.080836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec905476-5d26-4f42-99b6-2300aa055c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:37.081531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec905476-5d26-4f42-99b6-2300aa055c06 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:37.081806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec905476-5d26-4f42-99b6-2300aa055c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:37.082075 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec905476-5d26-4f42-99b6-2300aa055c06 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:37.082808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec905476-5d26-4f42-99b6-2300aa055c06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:37.084195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec905476-5d26-4f42-99b6-2300aa055c06 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:37.098796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 489/982] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:18:36 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:37.249058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7e3da-8361-4244-b667-e09787cb6407 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:37.249344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7e3da-8361-4244-b667-e09787cb6407 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:37.249622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7e3da-8361-4244-b667-e09787cb6407 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:37.251347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 494/983] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:37.256254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617d23-9ecf-441c-8df7-87f244d3cc28 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:37.256540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617d23-9ecf-441c-8df7-87f244d3cc28 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:37.256818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b617d23-9ecf-441c-8df7-87f244d3cc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:37.274170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5b617d23-9ecf-441c-8df7-87f244d3cc28 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:37.275469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5b617d23-9ecf-441c-8df7-87f244d3cc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:37.357470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 490/984] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:37.380039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7e3da-8361-4244-b667-e09787cb6407 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:37.448776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:37.490039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7e3da-8361-4244-b667-e09787cb6407 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:37.522866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6e51d-e1d0-4c7c-b885-eb101591088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:37.523678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e51d-e1d0-4c7c-b885-eb101591088a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:37.523958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e51d-e1d0-4c7c-b885-eb101591088a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:37.524229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6e51d-e1d0-4c7c-b885-eb101591088a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:37.524911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6e51d-e1d0-4c7c-b885-eb101591088a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:37.526280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6e51d-e1d0-4c7c-b885-eb101591088a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-0fe6e51d-e1d0-4c7c-b885-eb101591088a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:37.538269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:37.539219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:37.540064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 495/985] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:37.547527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617d23-9ecf-441c-8df7-87f244d3cc28 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:37.629997 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:37.654704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b617d23-9ecf-441c-8df7-87f244d3cc28 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:37.689323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4d3b5-b33d-4d1f-abbf-576cd492f7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:37.690002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4d3b5-b33d-4d1f-abbf-576cd492f7be None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:37.690287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4d3b5-b33d-4d1f-abbf-576cd492f7be None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:37.690564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a4d3b5-b33d-4d1f-abbf-576cd492f7be None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:37.691281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4d3b5-b33d-4d1f-abbf-576cd492f7be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:37.691591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4d3b5-b33d-4d1f-abbf-576cd492f7be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:37.693037 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a4d3b5-b33d-4d1f-abbf-576cd492f7be None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:37.697990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 491/986] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:37.703638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6e51d-e1d0-4c7c-b885-eb101591088a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:37.817891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6e51d-e1d0-4c7c-b885-eb101591088a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:37.844217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:37.854020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16dee8-6a3b-46b6-9da1-90fed9ec26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:37.855115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16dee8-6a3b-46b6-9da1-90fed9ec26ca None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:37.855448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16dee8-6a3b-46b6-9da1-90fed9ec26ca None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:37.855780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16dee8-6a3b-46b6-9da1-90fed9ec26ca None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:37.856638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16dee8-6a3b-46b6-9da1-90fed9ec26ca None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:37.856971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16dee8-6a3b-46b6-9da1-90fed9ec26ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:37.858367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16dee8-6a3b-46b6-9da1-90fed9ec26ca None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:37.863939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 496/987] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:37.869782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4d3b5-b33d-4d1f-abbf-576cd492f7be None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:37.969114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a4d3b5-b33d-4d1f-abbf-576cd492f7be None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:38.002734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd1f90-686f-47bd-94e6-dacc16ddab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:38.003382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd1f90-686f-47bd-94e6-dacc16ddab49 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:38.003662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd1f90-686f-47bd-94e6-dacc16ddab49 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:38.003928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd1f90-686f-47bd-94e6-dacc16ddab49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:38.004722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd1f90-686f-47bd-94e6-dacc16ddab49 None admin] RBAC: Adding query filter params (interface=admin, service_id=87e855f2a31a4dd58183cd37cc70a9f0, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:38.005059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd1f90-686f-47bd-94e6-dacc16ddab49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:38.006490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd1f90-686f-47bd-94e6-dacc16ddab49 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:38.011893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 492/988] 10.222.0.59 () {56 vars in 1249 bytes} [Fri Jul 1 16:18:37 2022] GET /identity/v3/endpoints?service_id=87e855f2a31a4dd58183cd37cc70a9f0&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:38.017406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16dee8-6a3b-46b6-9da1-90fed9ec26ca None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:38.123052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16dee8-6a3b-46b6-9da1-90fed9ec26ca None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:38.157907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258efcf-847e-4fa4-9d80-b346c965138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:38.158947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258efcf-847e-4fa4-9d80-b346c965138a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:38.159481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258efcf-847e-4fa4-9d80-b346c965138a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:38.159960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258efcf-847e-4fa4-9d80-b346c965138a None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:38.160897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258efcf-847e-4fa4-9d80-b346c965138a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:38.162490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258efcf-847e-4fa4-9d80-b346c965138a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:38.177477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 497/989] 10.222.0.59 () {56 vars in 1087 bytes} [Fri Jul 1 16:18:38 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:18:38.269552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65479724-7ca7-46c5-86fa-f1b08749cd3a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:38.269752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65479724-7ca7-46c5-86fa-f1b08749cd3a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:38.270030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65479724-7ca7-46c5-86fa-f1b08749cd3a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:38.271428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 493/990] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:38.277361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956e33e-a08e-46bf-b176-44beae6e1da1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:38.277642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956e33e-a08e-46bf-b176-44beae6e1da1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:38.277915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956e33e-a08e-46bf-b176-44beae6e1da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:38.295753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6956e33e-a08e-46bf-b176-44beae6e1da1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:38.297006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6956e33e-a08e-46bf-b176-44beae6e1da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:38.350349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:38.369733 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 498/991] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:38.391959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65479724-7ca7-46c5-86fa-f1b08749cd3a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:38.395234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:38.500437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65479724-7ca7-46c5-86fa-f1b08749cd3a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:38.535773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac18c05-acbf-46a1-8156-6cc503c90957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:38.536485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac18c05-acbf-46a1-8156-6cc503c90957 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:38.536722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac18c05-acbf-46a1-8156-6cc503c90957 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:38.537056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac18c05-acbf-46a1-8156-6cc503c90957 None admin] PATH_INFO: `/v3/services/image` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:38.537710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac18c05-acbf-46a1-8156-6cc503c90957 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:38.539087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac18c05-acbf-46a1-8156-6cc503c90957 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3ac18c05-acbf-46a1-8156-6cc503c90957 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:38.551276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:38.552342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:38.553213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 494/992] 10.222.0.59 () {56 vars in 1105 bytes} [Fri Jul 1 16:18:38 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:38.558743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956e33e-a08e-46bf-b176-44beae6e1da1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:38.660807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956e33e-a08e-46bf-b176-44beae6e1da1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:38.701828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172077-1b86-4b39-9b89-5914ffd00fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:38.702491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172077-1b86-4b39-9b89-5914ffd00fac None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:38.702768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172077-1b86-4b39-9b89-5914ffd00fac None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:38.703031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172077-1b86-4b39-9b89-5914ffd00fac None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:38.703737 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172077-1b86-4b39-9b89-5914ffd00fac None admin] RBAC: Adding query filter params (name=image) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:38.704038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172077-1b86-4b39-9b89-5914ffd00fac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:38.705440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172077-1b86-4b39-9b89-5914ffd00fac None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:38.710635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 499/993] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:38.716389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac18c05-acbf-46a1-8156-6cc503c90957 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:38.795588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:38.833753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac18c05-acbf-46a1-8156-6cc503c90957 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:38.869013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599ec11-a453-4874-8752-71d52c9b9be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:38.869682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599ec11-a453-4874-8752-71d52c9b9be1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:38.869961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599ec11-a453-4874-8752-71d52c9b9be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:38.870549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599ec11-a453-4874-8752-71d52c9b9be1 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:38.871121 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599ec11-a453-4874-8752-71d52c9b9be1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:38.871427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599ec11-a453-4874-8752-71d52c9b9be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:38.872980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599ec11-a453-4874-8752-71d52c9b9be1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:38.884876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 495/994] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:38 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:39.126969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b84f5-5887-42a5-a39b-e163867b2c62 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:39.127515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b84f5-5887-42a5-a39b-e163867b2c62 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:39.127515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b84f5-5887-42a5-a39b-e163867b2c62 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:39.129063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 500/995] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:39.134222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfaff01-9fb5-42c0-9fa4-c8851cdf570c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:39.134509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfaff01-9fb5-42c0-9fa4-c8851cdf570c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:39.134785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfaff01-9fb5-42c0-9fa4-c8851cdf570c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:39.152309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8dfaff01-9fb5-42c0-9fa4-c8851cdf570c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:39.153524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8dfaff01-9fb5-42c0-9fa4-c8851cdf570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:39.222741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 496/996] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:39.245507 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b84f5-5887-42a5-a39b-e163867b2c62 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:39.300914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:39.356455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b84f5-5887-42a5-a39b-e163867b2c62 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:39.391082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5994e37-09be-431a-a29d-b5728cef4304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:39.391806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5994e37-09be-431a-a29d-b5728cef4304 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:39.392087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5994e37-09be-431a-a29d-b5728cef4304 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:39.392359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5994e37-09be-431a-a29d-b5728cef4304 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:39.393038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5994e37-09be-431a-a29d-b5728cef4304 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:39.394420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5994e37-09be-431a-a29d-b5728cef4304 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b5994e37-09be-431a-a29d-b5728cef4304 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:39.406644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:39.407632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:39.413405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 501/997] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:39.416201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfaff01-9fb5-42c0-9fa4-c8851cdf570c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:39.476985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:39.520630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfaff01-9fb5-42c0-9fa4-c8851cdf570c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:39.554527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f89c-b231-4817-bd11-43cb23268453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:39.555198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f89c-b231-4817-bd11-43cb23268453 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:39.555472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f89c-b231-4817-bd11-43cb23268453 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:39.555744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9f89c-b231-4817-bd11-43cb23268453 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:39.556444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f89c-b231-4817-bd11-43cb23268453 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:39.556758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f89c-b231-4817-bd11-43cb23268453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:39.558184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea9f89c-b231-4817-bd11-43cb23268453 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:39.563648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 497/998] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:39.569403 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5994e37-09be-431a-a29d-b5728cef4304 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:39.668632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5994e37-09be-431a-a29d-b5728cef4304 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:39.681984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:39.703040 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a70206-436c-41c3-8b5e-a9b4a0e0ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:39.703703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a70206-436c-41c3-8b5e-a9b4a0e0ad98 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:39.703981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a70206-436c-41c3-8b5e-a9b4a0e0ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:39.704250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a70206-436c-41c3-8b5e-a9b4a0e0ad98 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:39.704986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a70206-436c-41c3-8b5e-a9b4a0e0ad98 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:39.705290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a70206-436c-41c3-8b5e-a9b4a0e0ad98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:39.706660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a70206-436c-41c3-8b5e-a9b4a0e0ad98 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:39.711794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 502/999] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:39.717713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f89c-b231-4817-bd11-43cb23268453 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:39.825983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9f89c-b231-4817-bd11-43cb23268453 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:39.856316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:39.867647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d308e10-bf91-4fac-b4af-9f1aac6bee1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:39.868315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d308e10-bf91-4fac-b4af-9f1aac6bee1c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:39.868594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d308e10-bf91-4fac-b4af-9f1aac6bee1c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:39.868884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d308e10-bf91-4fac-b4af-9f1aac6bee1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:39.869836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d308e10-bf91-4fac-b4af-9f1aac6bee1c None admin] RBAC: Adding query filter params (interface=public, service_id=406515d0c19a486983c21d674ff807a2, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:39.870173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d308e10-bf91-4fac-b4af-9f1aac6bee1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:39.871598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d308e10-bf91-4fac-b4af-9f1aac6bee1c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:39.881511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 498/1000] 10.222.0.59 () {56 vars in 1251 bytes} [Fri Jul 1 16:18:39 2022] GET /identity/v3/endpoints?service_id=406515d0c19a486983c21d674ff807a2&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:39.882967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a70206-436c-41c3-8b5e-a9b4a0e0ad98 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:39.989231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a70206-436c-41c3-8b5e-a9b4a0e0ad98 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:40.030451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aabe84-119d-42da-bd30-34c6eb24d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:40.031132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aabe84-119d-42da-bd30-34c6eb24d740 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:40.031424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aabe84-119d-42da-bd30-34c6eb24d740 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:40.031701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aabe84-119d-42da-bd30-34c6eb24d740 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:40.032391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aabe84-119d-42da-bd30-34c6eb24d740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:40.033803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aabe84-119d-42da-bd30-34c6eb24d740 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:40.048887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 503/1001] 10.222.0.59 () {56 vars in 1087 bytes} [Fri Jul 1 16:18:39 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:18:40.200505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e690f63-f0a8-4639-8617-616b4521385d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:40.200826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e690f63-f0a8-4639-8617-616b4521385d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:40.201088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e690f63-f0a8-4639-8617-616b4521385d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:40.202694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 499/1002] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:40.208113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295033-0db5-48b8-b0de-a688fc9160ff None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:40.208551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295033-0db5-48b8-b0de-a688fc9160ff None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:40.208715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295033-0db5-48b8-b0de-a688fc9160ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:40.229289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-79295033-0db5-48b8-b0de-a688fc9160ff None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:40.230837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-79295033-0db5-48b8-b0de-a688fc9160ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:40.270779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:40.312719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 504/1003] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:40.335344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e690f63-f0a8-4639-8617-616b4521385d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:40.439968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e690f63-f0a8-4639-8617-616b4521385d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:40.475173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06e57f-ef60-4b7f-b8d0-0d1468fd4e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:40.475990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06e57f-ef60-4b7f-b8d0-0d1468fd4e2c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:40.476273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06e57f-ef60-4b7f-b8d0-0d1468fd4e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:40.476554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06e57f-ef60-4b7f-b8d0-0d1468fd4e2c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:40.477241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06e57f-ef60-4b7f-b8d0-0d1468fd4e2c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:40.478637 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06e57f-ef60-4b7f-b8d0-0d1468fd4e2c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-de06e57f-ef60-4b7f-b8d0-0d1468fd4e2c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:40.491872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:40.493265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 01 16:18:40.494141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:40.496934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 500/1004] 10.222.0.59 () {56 vars in 1126 bytes} [Fri Jul 1 16:18:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:40.499263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295033-0db5-48b8-b0de-a688fc9160ff None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:40.610511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295033-0db5-48b8-b0de-a688fc9160ff None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:40.646801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71ade-23fc-4921-87c4-cd226989efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:40.647475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71ade-23fc-4921-87c4-cd226989efca None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:40.647759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71ade-23fc-4921-87c4-cd226989efca None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:40.648036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c71ade-23fc-4921-87c4-cd226989efca None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:40.648753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c71ade-23fc-4921-87c4-cd226989efca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:40.649104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c71ade-23fc-4921-87c4-cd226989efca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:40.650486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c71ade-23fc-4921-87c4-cd226989efca None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:40.655884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 505/1005] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:40.661506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06e57f-ef60-4b7f-b8d0-0d1468fd4e2c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:40.718189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:40.775505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06e57f-ef60-4b7f-b8d0-0d1468fd4e2c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:40.817818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889395-2b57-4b9a-be70-ed0f0dec4b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:40.818498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889395-2b57-4b9a-be70-ed0f0dec4b44 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:40.818771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889395-2b57-4b9a-be70-ed0f0dec4b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:40.819046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889395-2b57-4b9a-be70-ed0f0dec4b44 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:40.819763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889395-2b57-4b9a-be70-ed0f0dec4b44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:40.820072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889395-2b57-4b9a-be70-ed0f0dec4b44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:40.821511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889395-2b57-4b9a-be70-ed0f0dec4b44 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:40.827056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 501/1006] 10.222.0.59 () {56 vars in 1122 bytes} [Fri Jul 1 16:18:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:40.834703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71ade-23fc-4921-87c4-cd226989efca None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:40.872279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:40.882986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d19f6-9fc4-49a6-9d7d-cf63683e57f9 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:40.883506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d19f6-9fc4-49a6-9d7d-cf63683e57f9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:40.883506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d19f6-9fc4-49a6-9d7d-cf63683e57f9 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:40.885062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 502/1007] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:18:40.889738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54e92a-de9d-42ca-ad82-060a9af14d91 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:40.890013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54e92a-de9d-42ca-ad82-060a9af14d91 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:40.890307 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54e92a-de9d-42ca-ad82-060a9af14d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:40.908003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1d54e92a-de9d-42ca-ad82-060a9af14d91 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:40.909243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1d54e92a-de9d-42ca-ad82-060a9af14d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:40.942314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c71ade-23fc-4921-87c4-cd226989efca None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:40.976645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 503/1008] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:18:40.980545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae0c4f-040e-4c8a-994b-094bf6ac1551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:40.981316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0c4f-040e-4c8a-994b-094bf6ac1551 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:40.981600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0c4f-040e-4c8a-994b-094bf6ac1551 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:40.981895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae0c4f-040e-4c8a-994b-094bf6ac1551 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:40.982647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0c4f-040e-4c8a-994b-094bf6ac1551 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:40.984035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae0c4f-040e-4c8a-994b-094bf6ac1551 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:41.000779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 506/1009] 10.222.0.59 () {60 vars in 1144 bytes} [Fri Jul 1 16:18:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:18:41.004342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54e92a-de9d-42ca-ad82-060a9af14d91 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:41.059573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:41.118424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54e92a-de9d-42ca-ad82-060a9af14d91 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:41.162825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be27d65-cecc-408a-bb1e-fba98bcc99b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:41.163871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27d65-cecc-408a-bb1e-fba98bcc99b7 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:41.163871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27d65-cecc-408a-bb1e-fba98bcc99b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:41.164082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be27d65-cecc-408a-bb1e-fba98bcc99b7 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:41.164919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be27d65-cecc-408a-bb1e-fba98bcc99b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:41.166115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be27d65-cecc-408a-bb1e-fba98bcc99b7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:41.183988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 504/1010] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:18:41 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:42.080124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f72b1d-7798-4a98-a4f5-a1aef29246b4 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:42.080631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f72b1d-7798-4a98-a4f5-a1aef29246b4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:42.080631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f72b1d-7798-4a98-a4f5-a1aef29246b4 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:42.084886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 507/1011] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:42.087537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e1c02-c818-45eb-96f5-7935ff0b9ca1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:42.087947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e1c02-c818-45eb-96f5-7935ff0b9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:42.088124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e1c02-c818-45eb-96f5-7935ff0b9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:42.106145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-970e1c02-c818-45eb-96f5-7935ff0b9ca1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:42.108162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-970e1c02-c818-45eb-96f5-7935ff0b9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:42.188523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 505/1012] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:42 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:42.210976 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f72b1d-7798-4a98-a4f5-a1aef29246b4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:42.308926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:42.317601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f72b1d-7798-4a98-a4f5-a1aef29246b4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:42.352314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37612f8-967c-4e0b-88c6-054e41d01537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:42.353154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37612f8-967c-4e0b-88c6-054e41d01537 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:42.353415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37612f8-967c-4e0b-88c6-054e41d01537 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:42.353681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37612f8-967c-4e0b-88c6-054e41d01537 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:42.354335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37612f8-967c-4e0b-88c6-054e41d01537 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:42.356120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37612f8-967c-4e0b-88c6-054e41d01537 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b37612f8-967c-4e0b-88c6-054e41d01537 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:42.367913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:42.368960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 01 16:18:42.369898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:42.373246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 508/1013] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:42.375143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e1c02-c818-45eb-96f5-7935ff0b9ca1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:42.403828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:42.477587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e1c02-c818-45eb-96f5-7935ff0b9ca1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:42.512750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8092fd3-a58f-48fc-9e66-2400d926a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:42.513500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8092fd3-a58f-48fc-9e66-2400d926a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:42.513720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8092fd3-a58f-48fc-9e66-2400d926a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:42.514007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8092fd3-a58f-48fc-9e66-2400d926a4c1 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:42.514741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8092fd3-a58f-48fc-9e66-2400d926a4c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:42.515048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8092fd3-a58f-48fc-9e66-2400d926a4c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:42.516440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8092fd3-a58f-48fc-9e66-2400d926a4c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:42.521607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 506/1014] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:42.527250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37612f8-967c-4e0b-88c6-054e41d01537 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:42.626817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37612f8-967c-4e0b-88c6-054e41d01537 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:42.662238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f81ff-6c9f-47be-83be-e7b2000f2c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:42.662948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f81ff-6c9f-47be-83be-e7b2000f2c05 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:42.663244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f81ff-6c9f-47be-83be-e7b2000f2c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:42.663518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f81ff-6c9f-47be-83be-e7b2000f2c05 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:42.664228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f81ff-6c9f-47be-83be-e7b2000f2c05 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:42.664534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f81ff-6c9f-47be-83be-e7b2000f2c05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:42.665943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f81ff-6c9f-47be-83be-e7b2000f2c05 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:42.671279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 509/1015] 10.222.0.59 () {56 vars in 1112 bytes} [Fri Jul 1 16:18:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:42.676803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8092fd3-a58f-48fc-9e66-2400d926a4c1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:42.776918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:42.787326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8092fd3-a58f-48fc-9e66-2400d926a4c1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:42.821579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bb729-8eca-4ae8-ac69-fa85338f4aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:42.822254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bb729-8eca-4ae8-ac69-fa85338f4aa6 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:42.822535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bb729-8eca-4ae8-ac69-fa85338f4aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:42.822809 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bb729-8eca-4ae8-ac69-fa85338f4aa6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:42.823601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bb729-8eca-4ae8-ac69-fa85338f4aa6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:42.825044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bb729-8eca-4ae8-ac69-fa85338f4aa6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:42.851259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 507/1016] 10.222.0.59 () {60 vars in 1144 bytes} [Fri Jul 1 16:18:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:43.043472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022b020-2148-4bb1-a2de-b375c88cbe94 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.043735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022b020-2148-4bb1-a2de-b375c88cbe94 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.044002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022b020-2148-4bb1-a2de-b375c88cbe94 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.045646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 510/1017] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:43.051039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e3004-fb44-4ede-bea3-390192c7223a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.051328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e3004-fb44-4ede-bea3-390192c7223a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.051609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e3004-fb44-4ede-bea3-390192c7223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.069310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-694e3004-fb44-4ede-bea3-390192c7223a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:43.070532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-694e3004-fb44-4ede-bea3-390192c7223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:43.147312 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 508/1018] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:43.170896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022b020-2148-4bb1-a2de-b375c88cbe94 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:43.196813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:43.208778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b76e86-83fb-4fee-91f4-f580b46fc376 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.209109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b76e86-83fb-4fee-91f4-f580b46fc376 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.209343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b76e86-83fb-4fee-91f4-f580b46fc376 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.210730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 509/1019] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:18:43.215966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2854-3ef9-4467-94fc-85f06a29e72b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.216249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2854-3ef9-4467-94fc-85f06a29e72b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.216525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a2854-3ef9-4467-94fc-85f06a29e72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.233715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c06a2854-3ef9-4467-94fc-85f06a29e72b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:43.234937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c06a2854-3ef9-4467-94fc-85f06a29e72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:43.282600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022b020-2148-4bb1-a2de-b375c88cbe94 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:43.307895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 510/1020] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:18:43.326685 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3cde-ad00-4bd8-b0c3-93060808054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:43.327487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3cde-ad00-4bd8-b0c3-93060808054c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.327772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3cde-ad00-4bd8-b0c3-93060808054c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.328055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e3cde-ad00-4bd8-b0c3-93060808054c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.329248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e3cde-ad00-4bd8-b0c3-93060808054c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:43.330774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e3cde-ad00-4bd8-b0c3-93060808054c None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:43.331280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2854-3ef9-4467-94fc-85f06a29e72b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:43.333431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 511/1021] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:43.335388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:43.338256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3cde-ad00-4bd8-b0c3-93060808054c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:43.439393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:43.442828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a2854-3ef9-4467-94fc-85f06a29e72b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:43.450400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e3cde-ad00-4bd8-b0c3-93060808054c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:43.481522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c48930-9867-4ca7-acca-41827d4dbf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:43.482313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c48930-9867-4ca7-acca-41827d4dbf03 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.482653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c48930-9867-4ca7-acca-41827d4dbf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.482941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c48930-9867-4ca7-acca-41827d4dbf03 None admin] PATH_INFO: `/v3/services/image` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.483620 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c48930-9867-4ca7-acca-41827d4dbf03 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:43.485059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c48930-9867-4ca7-acca-41827d4dbf03 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:43.489842 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5df2c0-d8cf-41b5-9e69-b34ecc815d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:43.490502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5df2c0-d8cf-41b5-9e69-b34ecc815d92 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.490796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5df2c0-d8cf-41b5-9e69-b34ecc815d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.491066 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5df2c0-d8cf-41b5-9e69-b34ecc815d92 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.491765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5df2c0-d8cf-41b5-9e69-b34ecc815d92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:43.493231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5df2c0-d8cf-41b5-9e69-b34ecc815d92 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-52c48930-9867-4ca7-acca-41827d4dbf03 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:43.496986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:43.497971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:43.498825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 511/1022] 10.222.0.59 () {56 vars in 1105 bytes} [Fri Jul 1 16:18:43 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:43.504050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c48930-9867-4ca7-acca-41827d4dbf03 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:43.525099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 512/1023] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:18:43 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:18:43.581787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:43.621476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c48930-9867-4ca7-acca-41827d4dbf03 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:43.660550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa556ef-8127-4fd2-9b32-ea6b6bf4f64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:43.661276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa556ef-8127-4fd2-9b32-ea6b6bf4f64f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.661554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa556ef-8127-4fd2-9b32-ea6b6bf4f64f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.661828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa556ef-8127-4fd2-9b32-ea6b6bf4f64f None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.662555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa556ef-8127-4fd2-9b32-ea6b6bf4f64f None admin] RBAC: Adding query filter params (name=image) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:43.662858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa556ef-8127-4fd2-9b32-ea6b6bf4f64f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:43.664275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa556ef-8127-4fd2-9b32-ea6b6bf4f64f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:43.670336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 512/1024] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:43.675981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5df2c0-d8cf-41b5-9e69-b34ecc815d92 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:43.789428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5df2c0-d8cf-41b5-9e69-b34ecc815d92 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:43.824789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4a889-3d56-4d37-8ce5-7f63d30f2529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:43.825624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4a889-3d56-4d37-8ce5-7f63d30f2529 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.826002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4a889-3d56-4d37-8ce5-7f63d30f2529 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.826376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4a889-3d56-4d37-8ce5-7f63d30f2529 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.827191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4a889-3d56-4d37-8ce5-7f63d30f2529 None admin] RBAC: Adding query filter params (type=image) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:43.827595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4a889-3d56-4d37-8ce5-7f63d30f2529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:43.829096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4a889-3d56-4d37-8ce5-7f63d30f2529 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:43.834594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 513/1025] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:43.840518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa556ef-8127-4fd2-9b32-ea6b6bf4f64f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:43.943624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa556ef-8127-4fd2-9b32-ea6b6bf4f64f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:43.972970 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:43.980002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2f4c4-2212-4ed6-a72c-87ef5c34c295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:43.980780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2f4c4-2212-4ed6-a72c-87ef5c34c295 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:43.981188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2f4c4-2212-4ed6-a72c-87ef5c34c295 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:43.981558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2f4c4-2212-4ed6-a72c-87ef5c34c295 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:43.982455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2f4c4-2212-4ed6-a72c-87ef5c34c295 None admin] RBAC: Adding query filter params (interface=public, service_id=9b67b86a8da34ad2a831802953756c25, region_id=RegionOne) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:43.982884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2f4c4-2212-4ed6-a72c-87ef5c34c295 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:43.984365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2f4c4-2212-4ed6-a72c-87ef5c34c295 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:43.994244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 513/1026] 10.222.0.59 () {56 vars in 1251 bytes} [Fri Jul 1 16:18:43 2022] GET /identity/v3/endpoints?service_id=9b67b86a8da34ad2a831802953756c25&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:43.995671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4a889-3d56-4d37-8ce5-7f63d30f2529 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:44.007449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:44.109360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4a889-3d56-4d37-8ce5-7f63d30f2529 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:44.145412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46c0c8-8449-4cc2-af54-4c86a15b880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:44.146217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46c0c8-8449-4cc2-af54-4c86a15b880f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:44.146608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46c0c8-8449-4cc2-af54-4c86a15b880f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:44.146998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46c0c8-8449-4cc2-af54-4c86a15b880f None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:44.147783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46c0c8-8449-4cc2-af54-4c86a15b880f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:44.149426 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46c0c8-8449-4cc2-af54-4c86a15b880f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:44.156299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 514/1027] 10.222.0.59 () {56 vars in 1087 bytes} [Fri Jul 1 16:18:43 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:18:44.972231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6ba2e-c4cb-4693-90d8-a645d93b757b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:44.972778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6ba2e-c4cb-4693-90d8-a645d93b757b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:44.972778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6ba2e-c4cb-4693-90d8-a645d93b757b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:44.974330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 514/1028] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:44.979798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfb066-75d3-45c1-94e5-d9648735f9de None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:44.980267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfb066-75d3-45c1-94e5-d9648735f9de None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:44.980361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfb066-75d3-45c1-94e5-d9648735f9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:44.997303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-07dfb066-75d3-45c1-94e5-d9648735f9de None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:44.998400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-07dfb066-75d3-45c1-94e5-d9648735f9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:45.068569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 515/1029] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:45.091944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6ba2e-c4cb-4693-90d8-a645d93b757b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:45.194719 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6ba2e-c4cb-4693-90d8-a645d93b757b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:45.228494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46edfe-c7b3-4bf6-bd78-421be5c49e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:45.229770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46edfe-c7b3-4bf6-bd78-421be5c49e99 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:45.230099 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46edfe-c7b3-4bf6-bd78-421be5c49e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:45.230483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46edfe-c7b3-4bf6-bd78-421be5c49e99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:45.243198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46edfe-c7b3-4bf6-bd78-421be5c49e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-7b46edfe-c7b3-4bf6-bd78-421be5c49e99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:45.251751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:45.252702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:45.253923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:45.257231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 515/1030] 10.222.0.59 () {56 vars in 1120 bytes} [Fri Jul 1 16:18:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:45.259069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfb066-75d3-45c1-94e5-d9648735f9de None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:45.263364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:45.364807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfb066-75d3-45c1-94e5-d9648735f9de None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:45.403853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884a8ec-ab3b-4e62-86f3-c826ea1711f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:45.404946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884a8ec-ab3b-4e62-86f3-c826ea1711f3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:45.405450 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884a8ec-ab3b-4e62-86f3-c826ea1711f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:45.405923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884a8ec-ab3b-4e62-86f3-c826ea1711f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:45.406983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884a8ec-ab3b-4e62-86f3-c826ea1711f3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:45.407488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884a8ec-ab3b-4e62-86f3-c826ea1711f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:45.409092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884a8ec-ab3b-4e62-86f3-c826ea1711f3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:45.417762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 516/1031] 10.222.0.59 () {56 vars in 1115 bytes} [Fri Jul 1 16:18:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:45.423391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46edfe-c7b3-4bf6-bd78-421be5c49e99 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:45.485876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:45.532179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46edfe-c7b3-4bf6-bd78-421be5c49e99 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:45.567397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5950e28-3a18-460e-83c6-dd5c8d2ee102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:45.568199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5950e28-3a18-460e-83c6-dd5c8d2ee102 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:45.568486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5950e28-3a18-460e-83c6-dd5c8d2ee102 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:45.568761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5950e28-3a18-460e-83c6-dd5c8d2ee102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:45.579137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5950e28-3a18-460e-83c6-dd5c8d2ee102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:45.580622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5950e28-3a18-460e-83c6-dd5c8d2ee102 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:45.597840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16aba-8bfa-4402-abbb-9644f6b869f8 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:45.598122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16aba-8bfa-4402-abbb-9644f6b869f8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:45.598399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b16aba-8bfa-4402-abbb-9644f6b869f8 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b5950e28-3a18-460e-83c6-dd5c8d2ee102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:45.598512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:45.599315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:45.600206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:45.600206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:45.600206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:45.600206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:45.600425 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 517/1032] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:45.604147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 516/1033] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:45.605992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5950e28-3a18-460e-83c6-dd5c8d2ee102 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:45.606536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d983f-3cb7-40d7-ad75-18bcd71bb2af None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:45.606873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d983f-3cb7-40d7-ad75-18bcd71bb2af None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:45.607052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d983f-3cb7-40d7-ad75-18bcd71bb2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:45.627601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-424d983f-3cb7-40d7-ad75-18bcd71bb2af None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:45.628784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-424d983f-3cb7-40d7-ad75-18bcd71bb2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:45.704340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:45.711691 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5950e28-3a18-460e-83c6-dd5c8d2ee102 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:45.714354 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 518/1034] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:45.724885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:45.743573 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d983f-3cb7-40d7-ad75-18bcd71bb2af None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:45.754228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0b01c-90e9-4ff8-b643-b10836b57c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:45.754941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0b01c-90e9-4ff8-b643-b10836b57c76 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:45.755223 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0b01c-90e9-4ff8-b643-b10836b57c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:45.755493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0b01c-90e9-4ff8-b643-b10836b57c76 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:45.756218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0b01c-90e9-4ff8-b643-b10836b57c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:45.756519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0b01c-90e9-4ff8-b643-b10836b57c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:45.757949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0b01c-90e9-4ff8-b643-b10836b57c76 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:45.770213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 517/1035] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:45.776254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0b01c-90e9-4ff8-b643-b10836b57c76 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:45.846976 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d983f-3cb7-40d7-ad75-18bcd71bb2af None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:45.884540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cd8f8-c088-4fbd-8155-0be9614ad8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:45.885376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cd8f8-c088-4fbd-8155-0be9614ad8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:45.885657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cd8f8-c088-4fbd-8155-0be9614ad8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:45.885934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cd8f8-c088-4fbd-8155-0be9614ad8c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:45.887237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cd8f8-c088-4fbd-8155-0be9614ad8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:45.888688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174cd8f8-c088-4fbd-8155-0be9614ad8c5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:45.890524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 519/1036] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:45.896124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cd8f8-c088-4fbd-8155-0be9614ad8c5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:45.896471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0b01c-90e9-4ff8-b643-b10836b57c76 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:45.931516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2351-593e-451d-aed4-4555a8b271eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:45.932313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2351-593e-451d-aed4-4555a8b271eb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:45.932591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2351-593e-451d-aed4-4555a8b271eb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:45.932879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2351-593e-451d-aed4-4555a8b271eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:45.941134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f2351-593e-451d-aed4-4555a8b271eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:45.942772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f2351-593e-451d-aed4-4555a8b271eb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:45.957907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-fc0f2351-593e-451d-aed4-4555a8b271eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:45.959193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:45.960147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:45.961141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 518/1037] 10.222.0.59 () {56 vars in 1093 bytes} [Fri Jul 1 16:18:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:45.966384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2351-593e-451d-aed4-4555a8b271eb None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:45.997390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:46.002916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cd8f8-c088-4fbd-8155-0be9614ad8c5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:46.037234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4bbd4-9355-4966-bd6d-fa265d5cf810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:46.037910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4bbd4-9355-4966-bd6d-fa265d5cf810 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.038214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4bbd4-9355-4966-bd6d-fa265d5cf810 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.038466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4bbd4-9355-4966-bd6d-fa265d5cf810 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.039174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4bbd4-9355-4966-bd6d-fa265d5cf810 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:46.040617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4bbd4-9355-4966-bd6d-fa265d5cf810 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:46.064162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 520/1038] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:18:45 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:18:46.077732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2351-593e-451d-aed4-4555a8b271eb None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:46.117582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8741d-5f84-4d60-9acc-b31e994c3335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:46.118593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8741d-5f84-4d60-9acc-b31e994c3335 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.119051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8741d-5f84-4d60-9acc-b31e994c3335 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.119510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8741d-5f84-4d60-9acc-b31e994c3335 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.120697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8741d-5f84-4d60-9acc-b31e994c3335 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:46.121276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8741d-5f84-4d60-9acc-b31e994c3335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:46.123089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8741d-5f84-4d60-9acc-b31e994c3335 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:46.148372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 519/1039] 10.222.0.59 () {56 vars in 1133 bytes} [Fri Jul 1 16:18:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:46.149793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4bbd4-9355-4966-bd6d-fa265d5cf810 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:46.160682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce596df-e8bb-4172-91e3-62614e18a8bc None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.160995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce596df-e8bb-4172-91e3-62614e18a8bc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.161269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce596df-e8bb-4172-91e3-62614e18a8bc None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.162660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 520/1040] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:18:46.168465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246355-ed19-43cb-a984-839f577d94e8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.168988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246355-ed19-43cb-a984-839f577d94e8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.169238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc246355-ed19-43cb-a984-839f577d94e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.188994 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cc246355-ed19-43cb-a984-839f577d94e8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:46.190890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cc246355-ed19-43cb-a984-839f577d94e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:46.269540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4bbd4-9355-4966-bd6d-fa265d5cf810 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:46.270511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 521/1041] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:18:46.287713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:46.294196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc246355-ed19-43cb-a984-839f577d94e8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:46.306652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ec81e-73f6-461b-a182-3200a67c9ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:46.307314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ec81e-73f6-461b-a182-3200a67c9ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.307652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ec81e-73f6-461b-a182-3200a67c9ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.307868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ec81e-73f6-461b-a182-3200a67c9ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.312740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:46.380177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ec81e-73f6-461b-a182-3200a67c9ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:46.381608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ec81e-73f6-461b-a182-3200a67c9ce6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:46.401554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc246355-ed19-43cb-a984-839f577d94e8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:46.438422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a1f4a-e7fa-4235-8ecc-7ac5f5f8a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:46.439852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a1f4a-e7fa-4235-8ecc-7ac5f5f8a415 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.440217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a1f4a-e7fa-4235-8ecc-7ac5f5f8a415 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.440490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a1f4a-e7fa-4235-8ecc-7ac5f5f8a415 None admin] PATH_INFO: `/v3/services/image` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.441191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a1f4a-e7fa-4235-8ecc-7ac5f5f8a415 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:46.442780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a1f4a-e7fa-4235-8ecc-7ac5f5f8a415 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-5d5a1f4a-e7fa-4235-8ecc-7ac5f5f8a415 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:46.457330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:46.458339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:46.459179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 522/1042] 10.222.0.59 () {56 vars in 1105 bytes} [Fri Jul 1 16:18:46 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:46.464322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a1f4a-e7fa-4235-8ecc-7ac5f5f8a415 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:46.489803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 521/1043] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:18:46.495246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ec81e-73f6-461b-a182-3200a67c9ce6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:46.513333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:46.557273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:46.579863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a1f4a-e7fa-4235-8ecc-7ac5f5f8a415 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:46.596954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ec81e-73f6-461b-a182-3200a67c9ce6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:46.615780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675df8f-1d11-4152-9e31-37ea962d94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:46.616457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675df8f-1d11-4152-9e31-37ea962d94be None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.616740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675df8f-1d11-4152-9e31-37ea962d94be None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.617050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675df8f-1d11-4152-9e31-37ea962d94be None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.617759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675df8f-1d11-4152-9e31-37ea962d94be None admin] RBAC: Adding query filter params (name=image) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:46.618064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675df8f-1d11-4152-9e31-37ea962d94be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:46.619456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675df8f-1d11-4152-9e31-37ea962d94be None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:46.624401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 523/1044] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:46.629984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675df8f-1d11-4152-9e31-37ea962d94be None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:46.642477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c256c1-291e-43f3-878f-d4dab30ce565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:46.643208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c256c1-291e-43f3-878f-d4dab30ce565 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.643485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c256c1-291e-43f3-878f-d4dab30ce565 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.643762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c256c1-291e-43f3-878f-d4dab30ce565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.654133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c256c1-291e-43f3-878f-d4dab30ce565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:46.655598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c256c1-291e-43f3-878f-d4dab30ce565 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e2c256c1-291e-43f3-878f-d4dab30ce565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:46.674121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:46.675169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:46.676295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:46.676295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:46.676295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:46.676295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:46.680019 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 522/1045] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:46.680769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c256c1-291e-43f3-878f-d4dab30ce565 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:46.753272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:46.757702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675df8f-1d11-4152-9e31-37ea962d94be None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:46.791508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c256c1-291e-43f3-878f-d4dab30ce565 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:46.793807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135131e8-740c-4599-a0d3-0ca7a75ca464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:46.794482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135131e8-740c-4599-a0d3-0ca7a75ca464 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.794764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135131e8-740c-4599-a0d3-0ca7a75ca464 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.795036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135131e8-740c-4599-a0d3-0ca7a75ca464 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.795748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135131e8-740c-4599-a0d3-0ca7a75ca464 None admin] RBAC: Adding query filter params (type=image) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:46.796053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135131e8-740c-4599-a0d3-0ca7a75ca464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:46.797481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135131e8-740c-4599-a0d3-0ca7a75ca464 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:46.803132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 524/1046] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:46.808679 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135131e8-740c-4599-a0d3-0ca7a75ca464 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:46.820454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:46.834549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141d1ae-cba8-4c2d-a447-3eea397a5dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:46.835277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141d1ae-cba8-4c2d-a447-3eea397a5dea None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.835548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141d1ae-cba8-4c2d-a447-3eea397a5dea None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.835769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141d1ae-cba8-4c2d-a447-3eea397a5dea None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.836488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141d1ae-cba8-4c2d-a447-3eea397a5dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:46.836795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141d1ae-cba8-4c2d-a447-3eea397a5dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:46.838189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141d1ae-cba8-4c2d-a447-3eea397a5dea None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:46.855469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 523/1047] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:46.857524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141d1ae-cba8-4c2d-a447-3eea397a5dea None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:46.919459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135131e8-740c-4599-a0d3-0ca7a75ca464 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:46.953389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f35c1-83af-4e81-a5f6-d6dd84f0554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:46.954054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f35c1-83af-4e81-a5f6-d6dd84f0554e None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:46.954334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f35c1-83af-4e81-a5f6-d6dd84f0554e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:46.954608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f35c1-83af-4e81-a5f6-d6dd84f0554e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:46.955349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f35c1-83af-4e81-a5f6-d6dd84f0554e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:46.956738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f35c1-83af-4e81-a5f6-d6dd84f0554e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:46.979610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 525/1048] 10.222.0.59 () {60 vars in 1144 bytes} [Fri Jul 1 16:18:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:18:46.991560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141d1ae-cba8-4c2d-a447-3eea397a5dea None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:47.024879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:47.039217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a589-9306-4565-828d-0a850bb61714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:47.040037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a589-9306-4565-828d-0a850bb61714 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:47.040317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a589-9306-4565-828d-0a850bb61714 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:47.040587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a589-9306-4565-828d-0a850bb61714 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:47.048380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45a589-9306-4565-828d-0a850bb61714 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:47.049989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca45a589-9306-4565-828d-0a850bb61714 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-ca45a589-9306-4565-828d-0a850bb61714 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:47.065601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:47.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:47.067513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:47.067513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:47.067513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:47.067513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:47.067513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:47.067513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:47.067513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:47.067513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:47.069181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 524/1049] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:47.073154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f35c1-83af-4e81-a5f6-d6dd84f0554e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:47.143917 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:47.185024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f35c1-83af-4e81-a5f6-d6dd84f0554e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:47.218710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56bb4cb-c624-4b94-bf02-ab6d6675caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:47.219408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb4cb-c624-4b94-bf02-ab6d6675caa8 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:47.219689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb4cb-c624-4b94-bf02-ab6d6675caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:47.219963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56bb4cb-c624-4b94-bf02-ab6d6675caa8 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:47.220774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bb4cb-c624-4b94-bf02-ab6d6675caa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:47.221134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bb4cb-c624-4b94-bf02-ab6d6675caa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:47.222635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56bb4cb-c624-4b94-bf02-ab6d6675caa8 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:47.237152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 526/1050] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:47.243230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a589-9306-4565-828d-0a850bb61714 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:47.342904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a589-9306-4565-828d-0a850bb61714 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:47.377473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490a1da-94c4-45bd-9b70-de30516086c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:47.378127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490a1da-94c4-45bd-9b70-de30516086c5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:47.378408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490a1da-94c4-45bd-9b70-de30516086c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:47.378677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490a1da-94c4-45bd-9b70-de30516086c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:47.379501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490a1da-94c4-45bd-9b70-de30516086c5 None admin] RBAC: Adding query filter params (role.id=f0bf50799b744d459a9f485d4c1f45b7, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=efdfb91ba4c04452ba547baa184185c4) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:47.379807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490a1da-94c4-45bd-9b70-de30516086c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:47.381269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490a1da-94c4-45bd-9b70-de30516086c5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:47.386986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 525/1051] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:47 2022] GET /identity/v3/role_assignments?user.id=efdfb91ba4c04452ba547baa184185c4&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=f0bf50799b744d459a9f485d4c1f45b7 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:48.165201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dca34-634d-49c5-bfb3-b41eee871ebb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:48.165766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dca34-634d-49c5-bfb3-b41eee871ebb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:48.165766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dca34-634d-49c5-bfb3-b41eee871ebb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:48.167281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 527/1052] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:48.172609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4b929-1b46-4a1f-a980-09873ce5861b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:48.173106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4b929-1b46-4a1f-a980-09873ce5861b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:48.173199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4b929-1b46-4a1f-a980-09873ce5861b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:48.190781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4bd4b929-1b46-4a1f-a980-09873ce5861b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:48.191968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4bd4b929-1b46-4a1f-a980-09873ce5861b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:48.237587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:48.258793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 526/1053] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:48.282065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dca34-634d-49c5-bfb3-b41eee871ebb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:48.381712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dca34-634d-49c5-bfb3-b41eee871ebb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:48.404770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:48.416701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cad40-0997-4403-bc23-7f80400c76ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:48.417385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cad40-0997-4403-bc23-7f80400c76ef None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:48.417669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cad40-0997-4403-bc23-7f80400c76ef None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:48.417942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cad40-0997-4403-bc23-7f80400c76ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:48.428321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cad40-0997-4403-bc23-7f80400c76ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ea7cad40-0997-4403-bc23-7f80400c76ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:48.436094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:48.437032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:48.437951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 528/1054] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:48.443237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4b929-1b46-4a1f-a980-09873ce5861b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:48.547610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4b929-1b46-4a1f-a980-09873ce5861b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:48.581543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5844b9a-96a8-4778-b26d-f6b5da8c9ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:48.582223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5844b9a-96a8-4778-b26d-f6b5da8c9ebb None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:48.582502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5844b9a-96a8-4778-b26d-f6b5da8c9ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:48.582776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5844b9a-96a8-4778-b26d-f6b5da8c9ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:48.583519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5844b9a-96a8-4778-b26d-f6b5da8c9ebb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:48.583824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5844b9a-96a8-4778-b26d-f6b5da8c9ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:48.585241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5844b9a-96a8-4778-b26d-f6b5da8c9ebb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:48.593761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 527/1055] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:48.599443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cad40-0997-4403-bc23-7f80400c76ef None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:48.702549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cad40-0997-4403-bc23-7f80400c76ef None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:48.742156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d22a3-85d0-4d75-9d09-8baf7d733858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:48.742156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d22a3-85d0-4d75-9d09-8baf7d733858 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:48.742974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d22a3-85d0-4d75-9d09-8baf7d733858 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:48.742974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d22a3-85d0-4d75-9d09-8baf7d733858 None admin] PATH_INFO: `/v3/users/83d16ff9e77d4e1e9a907f6ca477367a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:48.760200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d22a3-85d0-4d75-9d09-8baf7d733858 None admin] RBAC: Authorizing `identity:get_user(user_id=83d16ff9e77d4e1e9a907f6ca477367a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:48.761965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d22a3-85d0-4d75-9d09-8baf7d733858 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:48.768356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 529/1056] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:18:48 2022] GET /identity/v3/users/83d16ff9e77d4e1e9a907f6ca477367a => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:48.769560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5844b9a-96a8-4778-b26d-f6b5da8c9ebb None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:48.823746 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:48.881845 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5844b9a-96a8-4778-b26d-f6b5da8c9ebb None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:48.917747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa1ce7-155c-4ab8-958d-dca1b179142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:48.918399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa1ce7-155c-4ab8-958d-dca1b179142f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:48.918677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa1ce7-155c-4ab8-958d-dca1b179142f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:48.918944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa1ce7-155c-4ab8-958d-dca1b179142f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:48.993955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa1ce7-155c-4ab8-958d-dca1b179142f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:48.995394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa1ce7-155c-4ab8-958d-dca1b179142f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:49.025768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a3491-581f-4c85-98c9-791dc8e21adc None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.026286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a3491-581f-4c85-98c9-791dc8e21adc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.026672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a3491-581f-4c85-98c9-791dc8e21adc None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.028269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 530/1057] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:49.033359 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1596-f542-4712-bb3d-a47eaaaa4ac0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.033648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1596-f542-4712-bb3d-a47eaaaa4ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.033929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a1596-f542-4712-bb3d-a47eaaaa4ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.041558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:49.050728 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e00a1596-f542-4712-bb3d-a47eaaaa4ac0 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:49.052095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e00a1596-f542-4712-bb3d-a47eaaaa4ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:49.088627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:49.113024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 528/1058] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:18:49.118197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa1ce7-155c-4ab8-958d-dca1b179142f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:49.128282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 531/1059] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:49.150340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a1596-f542-4712-bb3d-a47eaaaa4ac0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:49.224283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa1ce7-155c-4ab8-958d-dca1b179142f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:49.252661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a1596-f542-4712-bb3d-a47eaaaa4ac0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:49.268615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134c4e2-ac9c-4dd9-8884-a07747a04f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:49.269893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134c4e2-ac9c-4dd9-8884-a07747a04f7d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.270571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134c4e2-ac9c-4dd9-8884-a07747a04f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.270994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134c4e2-ac9c-4dd9-8884-a07747a04f7d None admin] PATH_INFO: `/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.272356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134c4e2-ac9c-4dd9-8884-a07747a04f7d None admin] RBAC: Authorizing `identity:get_project(project_id=4ef97a8a43a24c04a310b06b4f64a2ca)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:49.274714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0134c4e2-ac9c-4dd9-8884-a07747a04f7d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:49.277739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 529/1060] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:18:49 2022] GET /identity/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:49.283755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134c4e2-ac9c-4dd9-8884-a07747a04f7d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:49.286956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57177a-f89a-41b6-bba8-5c6b744b1491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:49.287613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57177a-f89a-41b6-bba8-5c6b744b1491 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.287893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57177a-f89a-41b6-bba8-5c6b744b1491 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.288164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57177a-f89a-41b6-bba8-5c6b744b1491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.299873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:49.332171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:49.362647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57177a-f89a-41b6-bba8-5c6b744b1491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:49.364279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57177a-f89a-41b6-bba8-5c6b744b1491 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:49.405220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134c4e2-ac9c-4dd9-8884-a07747a04f7d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:49.440897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002312b3-621c-46e6-85f7-ed58a95db218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:49.441542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002312b3-621c-46e6-85f7-ed58a95db218 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.441818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002312b3-621c-46e6-85f7-ed58a95db218 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.442086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002312b3-621c-46e6-85f7-ed58a95db218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.442915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002312b3-621c-46e6-85f7-ed58a95db218 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=4ef97a8a43a24c04a310b06b4f64a2ca, user.id=83d16ff9e77d4e1e9a907f6ca477367a) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:49.443258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002312b3-621c-46e6-85f7-ed58a95db218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:49.444675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002312b3-621c-46e6-85f7-ed58a95db218 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:49.459336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 530/1061] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:49 2022] GET /identity/v3/role_assignments?user.id=83d16ff9e77d4e1e9a907f6ca477367a&scope.project.id=4ef97a8a43a24c04a310b06b4f64a2ca&role.id=842af9e8967047df873d061df391e820 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:49.459336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44546f-f19f-4348-8ccd-f03223693aa5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.459336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44546f-f19f-4348-8ccd-f03223693aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.459336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44546f-f19f-4348-8ccd-f03223693aa5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.459336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 531/1062] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:49.465330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43142117-d627-4246-a11a-6473e91fb756 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.465686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43142117-d627-4246-a11a-6473e91fb756 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.465891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43142117-d627-4246-a11a-6473e91fb756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.472834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 532/1063] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:18:49.479931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57177a-f89a-41b6-bba8-5c6b744b1491 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:49.489287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-43142117-d627-4246-a11a-6473e91fb756 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:49.491505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-43142117-d627-4246-a11a-6473e91fb756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:49.575670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 532/1064] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:18:49.582133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:49.598638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43142117-d627-4246-a11a-6473e91fb756 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:49.602702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:49.619288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57177a-f89a-41b6-bba8-5c6b744b1491 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:49.670487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc5296-6fc2-412c-8202-2b22ff586214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:49.671333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5296-6fc2-412c-8202-2b22ff586214 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.671617 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5296-6fc2-412c-8202-2b22ff586214 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.671907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5296-6fc2-412c-8202-2b22ff586214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.683163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc5296-6fc2-412c-8202-2b22ff586214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:49.684649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc5296-6fc2-412c-8202-2b22ff586214 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c2cc5296-6fc2-412c-8202-2b22ff586214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:49.705965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:49.706912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:49.712979 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:49.712979 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:49.712979 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:49.712979 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:49.713220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43142117-d627-4246-a11a-6473e91fb756 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:49.713312 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 533/1065] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:49.716155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc5296-6fc2-412c-8202-2b22ff586214 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:49.758672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e4cd-7b37-474d-847d-9062a2de2b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:49.760343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e4cd-7b37-474d-847d-9062a2de2b93 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.760643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e4cd-7b37-474d-847d-9062a2de2b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.764149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e4cd-7b37-474d-847d-9062a2de2b93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.780010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4e4cd-7b37-474d-847d-9062a2de2b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-92b4e4cd-7b37-474d-847d-9062a2de2b93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:49.788237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:49.789204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:49.790060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:49.794744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 533/1066] 10.222.0.59 () {56 vars in 1120 bytes} [Fri Jul 1 16:18:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:49.795699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e4cd-7b37-474d-847d-9062a2de2b93 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:49.827443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc5296-6fc2-412c-8202-2b22ff586214 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:49.852942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:49.860896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:49.866543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad1b24-8776-4836-9372-87fc9011891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:49.867479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad1b24-8776-4836-9372-87fc9011891f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.867761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad1b24-8776-4836-9372-87fc9011891f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.868172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad1b24-8776-4836-9372-87fc9011891f None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.868838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad1b24-8776-4836-9372-87fc9011891f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:49.869148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad1b24-8776-4836-9372-87fc9011891f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:49.870658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad1b24-8776-4836-9372-87fc9011891f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:49.882462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 534/1067] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:49.915996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e4cd-7b37-474d-847d-9062a2de2b93 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:49.957885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48488c2-3610-4e51-8cc3-e741a9b458d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:49.958574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48488c2-3610-4e51-8cc3-e741a9b458d2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:49.958858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48488c2-3610-4e51-8cc3-e741a9b458d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:49.959123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48488c2-3610-4e51-8cc3-e741a9b458d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:49.959894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48488c2-3610-4e51-8cc3-e741a9b458d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:49.960199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48488c2-3610-4e51-8cc3-e741a9b458d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:49.961655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48488c2-3610-4e51-8cc3-e741a9b458d2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:49.972045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 534/1068] 10.222.0.59 () {56 vars in 1115 bytes} [Fri Jul 1 16:18:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:49.977900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad1b24-8776-4836-9372-87fc9011891f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:50.090737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad1b24-8776-4836-9372-87fc9011891f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:50.125885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788035-2859-43eb-95ff-ec3266e42922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:50.126681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788035-2859-43eb-95ff-ec3266e42922 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:50.127038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788035-2859-43eb-95ff-ec3266e42922 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:50.127257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba788035-2859-43eb-95ff-ec3266e42922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:50.138077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba788035-2859-43eb-95ff-ec3266e42922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:50.139548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba788035-2859-43eb-95ff-ec3266e42922 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ba788035-2859-43eb-95ff-ec3266e42922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:50.156995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:50.157935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:50.158832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:50.158832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:50.158832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:50.158832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:50.158832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 535/1069] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:50.163933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48488c2-3610-4e51-8cc3-e741a9b458d2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:50.268824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48488c2-3610-4e51-8cc3-e741a9b458d2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:50.293871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:50.303851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1b52b-bfc3-420f-a6ff-bce317010006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:50.304517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1b52b-bfc3-420f-a6ff-bce317010006 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:50.304799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1b52b-bfc3-420f-a6ff-bce317010006 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:50.305108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1b52b-bfc3-420f-a6ff-bce317010006 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:50.305825 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1b52b-bfc3-420f-a6ff-bce317010006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:50.306132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1b52b-bfc3-420f-a6ff-bce317010006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:50.307506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d1b52b-bfc3-420f-a6ff-bce317010006 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:50.319493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 535/1070] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:50.325342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788035-2859-43eb-95ff-ec3266e42922 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:50.364146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:50.429303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba788035-2859-43eb-95ff-ec3266e42922 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:50.463589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7b187-200e-4a16-beb6-794053534013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:50.464474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7b187-200e-4a16-beb6-794053534013 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:50.464750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7b187-200e-4a16-beb6-794053534013 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:50.465040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7b187-200e-4a16-beb6-794053534013 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:50.472826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7b187-200e-4a16-beb6-794053534013 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:50.474304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7b187-200e-4a16-beb6-794053534013 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a3d7b187-200e-4a16-beb6-794053534013 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:50.488753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:50.489823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:50.490775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 536/1071] 10.222.0.59 () {56 vars in 1093 bytes} [Fri Jul 1 16:18:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:50.496252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1b52b-bfc3-420f-a6ff-bce317010006 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:50.599151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1b52b-bfc3-420f-a6ff-bce317010006 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:50.635508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee21d-510b-4314-a865-c707664636e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:50.636053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee21d-510b-4314-a865-c707664636e0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:50.636334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee21d-510b-4314-a865-c707664636e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:50.636607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ee21d-510b-4314-a865-c707664636e0 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:50.637483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ee21d-510b-4314-a865-c707664636e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:50.637794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ee21d-510b-4314-a865-c707664636e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:50.639242 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ee21d-510b-4314-a865-c707664636e0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:50.656722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 536/1072] 10.222.0.59 () {56 vars in 1133 bytes} [Fri Jul 1 16:18:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:50.662566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7b187-200e-4a16-beb6-794053534013 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:50.762316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:50.768855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7b187-200e-4a16-beb6-794053534013 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:50.803268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cdbb4-1f53-4699-859d-c7ad63c89af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:50.804056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cdbb4-1f53-4699-859d-c7ad63c89af7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:50.804337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cdbb4-1f53-4699-859d-c7ad63c89af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:50.804606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84cdbb4-1f53-4699-859d-c7ad63c89af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:50.815455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cdbb4-1f53-4699-859d-c7ad63c89af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:50.816980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84cdbb4-1f53-4699-859d-c7ad63c89af7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b84cdbb4-1f53-4699-859d-c7ad63c89af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:50.834836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:50.835872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:50.841831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:50.841831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:50.841831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:50.841831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:50.841831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 537/1073] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:50.842113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee21d-510b-4314-a865-c707664636e0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:50.890833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:50.947417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ee21d-510b-4314-a865-c707664636e0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:50.984171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849e464-7ff8-491e-8aa4-39071bfcd619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:50.984834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849e464-7ff8-491e-8aa4-39071bfcd619 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:50.985149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849e464-7ff8-491e-8aa4-39071bfcd619 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:50.985429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7849e464-7ff8-491e-8aa4-39071bfcd619 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:50.986156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849e464-7ff8-491e-8aa4-39071bfcd619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:50.986462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849e464-7ff8-491e-8aa4-39071bfcd619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:50.987826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7849e464-7ff8-491e-8aa4-39071bfcd619 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:50.999432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 537/1074] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:51.005493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cdbb4-1f53-4699-859d-c7ad63c89af7 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:51.114429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84cdbb4-1f53-4699-859d-c7ad63c89af7 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:51.149416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a04bcc-af28-4cae-a699-76d97080ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:51.150130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04bcc-af28-4cae-a699-76d97080ab29 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:51.150404 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04bcc-af28-4cae-a699-76d97080ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:51.150679 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04bcc-af28-4cae-a699-76d97080ab29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:51.157746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a04bcc-af28-4cae-a699-76d97080ab29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:51.159201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a04bcc-af28-4cae-a699-76d97080ab29 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a7a04bcc-af28-4cae-a699-76d97080ab29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:51.173184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:51.174102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:51.175004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:51.175004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:51.175004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:51.175004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:51.175004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:51.175004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:51.175004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:51.175004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:51.175004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 538/1075] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:51.180498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849e464-7ff8-491e-8aa4-39071bfcd619 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:51.287707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7849e464-7ff8-491e-8aa4-39071bfcd619 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:51.290083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:51.322946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72cd46-3f7b-415e-8db8-3a7d9c12a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:51.323632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72cd46-3f7b-415e-8db8-3a7d9c12a1ac None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:51.323917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72cd46-3f7b-415e-8db8-3a7d9c12a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:51.324192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72cd46-3f7b-415e-8db8-3a7d9c12a1ac None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:51.325013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72cd46-3f7b-415e-8db8-3a7d9c12a1ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:51.325319 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72cd46-3f7b-415e-8db8-3a7d9c12a1ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:51.326766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72cd46-3f7b-415e-8db8-3a7d9c12a1ac None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:51.339090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 538/1076] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:51.345287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a04bcc-af28-4cae-a699-76d97080ab29 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:51.357053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:51.453596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a04bcc-af28-4cae-a699-76d97080ab29 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:51.489739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10344b-d087-45eb-b59d-2aceba35f550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:51.490765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10344b-d087-45eb-b59d-2aceba35f550 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:51.491184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10344b-d087-45eb-b59d-2aceba35f550 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:51.491466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10344b-d087-45eb-b59d-2aceba35f550 None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/efdfb91ba4c04452ba547baa184185c4/roles/f0bf50799b744d459a9f485d4c1f45b7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:51.493893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10344b-d087-45eb-b59d-2aceba35f550 None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=efdfb91ba4c04452ba547baa184185c4, role_id=f0bf50799b744d459a9f485d4c1f45b7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:51.495419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10344b-d087-45eb-b59d-2aceba35f550 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:51.509774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 539/1077] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:18:51 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/efdfb91ba4c04452ba547baa184185c4/roles/f0bf50799b744d459a9f485d4c1f45b7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:18:51.516719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42ec75-a077-42be-bf5c-34caff52c20f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:51.517041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42ec75-a077-42be-bf5c-34caff52c20f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:51.517380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42ec75-a077-42be-bf5c-34caff52c20f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:51.518822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 539/1078] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:51.524863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d164893-ea99-4aac-8659-bef99f601050 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:51.525189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d164893-ea99-4aac-8659-bef99f601050 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:51.525469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d164893-ea99-4aac-8659-bef99f601050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:51.543233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6d164893-ea99-4aac-8659-bef99f601050 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:51.544482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6d164893-ea99-4aac-8659-bef99f601050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:51.612351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:51.618569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 540/1079] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:51.645754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42ec75-a077-42be-bf5c-34caff52c20f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:51.754759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42ec75-a077-42be-bf5c-34caff52c20f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:51.790238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a059b3-8971-4b78-aa82-2e8e9054042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:51.791034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a059b3-8971-4b78-aa82-2e8e9054042c None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:51.791308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a059b3-8971-4b78-aa82-2e8e9054042c None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:51.791574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a059b3-8971-4b78-aa82-2e8e9054042c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:51.802391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a059b3-8971-4b78-aa82-2e8e9054042c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-b6a059b3-8971-4b78-aa82-2e8e9054042c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:51.810026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:51.810995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:51.811838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 540/1080] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:51.817495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d164893-ea99-4aac-8659-bef99f601050 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:51.920806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d164893-ea99-4aac-8659-bef99f601050 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:51.955243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6c02b-fb03-400f-ad8b-a986a94a40a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:51.955920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6c02b-fb03-400f-ad8b-a986a94a40a6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:51.956259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6c02b-fb03-400f-ad8b-a986a94a40a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:51.956534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e6c02b-fb03-400f-ad8b-a986a94a40a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:51.957295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6c02b-fb03-400f-ad8b-a986a94a40a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:51.957598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6c02b-fb03-400f-ad8b-a986a94a40a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:51.958982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e6c02b-fb03-400f-ad8b-a986a94a40a6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:51.967969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 541/1081] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:51.973997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a059b3-8971-4b78-aa82-2e8e9054042c None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:52.000592 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:52.077159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a059b3-8971-4b78-aa82-2e8e9054042c None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:52.111960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59be2b-a620-4e67-8380-c7af1680a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:52.112872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59be2b-a620-4e67-8380-c7af1680a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:52.113168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59be2b-a620-4e67-8380-c7af1680a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:52.113434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59be2b-a620-4e67-8380-c7af1680a8d6 None admin] PATH_INFO: `/v3/users/83d16ff9e77d4e1e9a907f6ca477367a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:52.114650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59be2b-a620-4e67-8380-c7af1680a8d6 None admin] RBAC: Authorizing `identity:get_user(user_id=83d16ff9e77d4e1e9a907f6ca477367a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:52.116069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59be2b-a620-4e67-8380-c7af1680a8d6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:52.117755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 541/1082] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:18:51 2022] GET /identity/v3/users/83d16ff9e77d4e1e9a907f6ca477367a => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:52.123756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6c02b-fb03-400f-ad8b-a986a94a40a6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:52.186400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:52.231560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e6c02b-fb03-400f-ad8b-a986a94a40a6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:52.268562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba322314-6f64-4973-9c47-2ccb06ae4301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:52.269376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba322314-6f64-4973-9c47-2ccb06ae4301 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:52.269657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba322314-6f64-4973-9c47-2ccb06ae4301 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:52.269928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba322314-6f64-4973-9c47-2ccb06ae4301 None admin] PATH_INFO: `/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:52.271161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba322314-6f64-4973-9c47-2ccb06ae4301 None admin] RBAC: Authorizing `identity:get_project(project_id=4ef97a8a43a24c04a310b06b4f64a2ca)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:52.272603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba322314-6f64-4973-9c47-2ccb06ae4301 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:52.274385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 542/1083] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:18:52 2022] GET /identity/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:52.280481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59be2b-a620-4e67-8380-c7af1680a8d6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:52.372595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:52.382762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59be2b-a620-4e67-8380-c7af1680a8d6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:52.418006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de229b7b-8108-44cc-810d-8b1c7c32a3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:52.418896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de229b7b-8108-44cc-810d-8b1c7c32a3bf None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:52.419175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de229b7b-8108-44cc-810d-8b1c7c32a3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:52.419454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de229b7b-8108-44cc-810d-8b1c7c32a3bf None admin] PATH_INFO: `/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca/users/83d16ff9e77d4e1e9a907f6ca477367a/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:52.421504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de229b7b-8108-44cc-810d-8b1c7c32a3bf None admin] RBAC: Authorizing `identity:create_grant(project_id=4ef97a8a43a24c04a310b06b4f64a2ca, user_id=83d16ff9e77d4e1e9a907f6ca477367a, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:52.422954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de229b7b-8108-44cc-810d-8b1c7c32a3bf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:52.437514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 542/1084] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:18:52 2022] PUT /identity/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca/users/83d16ff9e77d4e1e9a907f6ca477367a/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:18:53.517456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8dc3-8c88-4abe-a7c6-3c55832c83bc None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:53.518061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8dc3-8c88-4abe-a7c6-3c55832c83bc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:53.518061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7e8dc3-8c88-4abe-a7c6-3c55832c83bc None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:53.519368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 543/1085] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:53.525335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e349370-4308-46fb-be8f-8200171c8269 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:53.526033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e349370-4308-46fb-be8f-8200171c8269 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:53.526033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e349370-4308-46fb-be8f-8200171c8269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:53.544927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5e349370-4308-46fb-be8f-8200171c8269 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:53.546155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5e349370-4308-46fb-be8f-8200171c8269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:53.614743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 543/1086] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:53.641652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e8dc3-8c88-4abe-a7c6-3c55832c83bc None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:53.762467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7e8dc3-8c88-4abe-a7c6-3c55832c83bc None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:53.790523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:53.799766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b89dc3-a176-4ea0-b2f0-3a55984730fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:53.800619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b89dc3-a176-4ea0-b2f0-3a55984730fa None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:53.800897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b89dc3-a176-4ea0-b2f0-3a55984730fa None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:53.801209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b89dc3-a176-4ea0-b2f0-3a55984730fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:53.812126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b89dc3-a176-4ea0-b2f0-3a55984730fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-76b89dc3-a176-4ea0-b2f0-3a55984730fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:53.820279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:53.821575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:53.823516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 544/1087] 10.222.0.59 () {56 vars in 1120 bytes} [Fri Jul 1 16:18:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:53.828000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e349370-4308-46fb-be8f-8200171c8269 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:53.911613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:53.934749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e349370-4308-46fb-be8f-8200171c8269 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:53.972520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da582dd7-f6d1-47c7-87fe-046a7db9bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:53.973227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da582dd7-f6d1-47c7-87fe-046a7db9bed5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:53.973509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da582dd7-f6d1-47c7-87fe-046a7db9bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:53.973783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da582dd7-f6d1-47c7-87fe-046a7db9bed5 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:53.974530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da582dd7-f6d1-47c7-87fe-046a7db9bed5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:53.974844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da582dd7-f6d1-47c7-87fe-046a7db9bed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:53.976219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da582dd7-f6d1-47c7-87fe-046a7db9bed5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:53.987259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 544/1088] 10.222.0.59 () {56 vars in 1115 bytes} [Fri Jul 1 16:18:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:53.993342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b89dc3-a176-4ea0-b2f0-3a55984730fa None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:54.108240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b89dc3-a176-4ea0-b2f0-3a55984730fa None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:54.145849 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fd466-73fb-4056-9782-76419a7f5569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:54.146674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fd466-73fb-4056-9782-76419a7f5569 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:54.146952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fd466-73fb-4056-9782-76419a7f5569 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:54.147222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fd466-73fb-4056-9782-76419a7f5569 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:54.158795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fd466-73fb-4056-9782-76419a7f5569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:54.160276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4fd466-73fb-4056-9782-76419a7f5569 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-9c4fd466-73fb-4056-9782-76419a7f5569 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:54.178634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:54.179717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:54.180646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:54.180646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:54.180646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:54.180646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:54.180646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 545/1089] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:54.185946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da582dd7-f6d1-47c7-87fe-046a7db9bed5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:54.303563 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da582dd7-f6d1-47c7-87fe-046a7db9bed5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:54.342563 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87722c-4e94-42a4-9168-d1c245fa3d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:54.343235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87722c-4e94-42a4-9168-d1c245fa3d33 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:54.343682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87722c-4e94-42a4-9168-d1c245fa3d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:54.344104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87722c-4e94-42a4-9168-d1c245fa3d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:54.344835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87722c-4e94-42a4-9168-d1c245fa3d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:54.345172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87722c-4e94-42a4-9168-d1c245fa3d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:54.346571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87722c-4e94-42a4-9168-d1c245fa3d33 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:54.359451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 545/1090] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:54.365192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fd466-73fb-4056-9782-76419a7f5569 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:54.414565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:54.466396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c10f9-32cb-4cfc-8f15-b23b864ac0a4 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:54.466689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c10f9-32cb-4cfc-8f15-b23b864ac0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:54.466957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c10f9-32cb-4cfc-8f15-b23b864ac0a4 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:54.468546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 546/1091] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:54.474919 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13e15d-dc28-4e0c-b8ca-2002d19bc65c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:54.475239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13e15d-dc28-4e0c-b8ca-2002d19bc65c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:54.475514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13e15d-dc28-4e0c-b8ca-2002d19bc65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:54.480854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fd466-73fb-4056-9782-76419a7f5569 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:54.482768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:54.494738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ad13e15d-dc28-4e0c-b8ca-2002d19bc65c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:54.496054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ad13e15d-dc28-4e0c-b8ca-2002d19bc65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:54.525146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00dffb-1682-4029-8653-9f706d488bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:54.526053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00dffb-1682-4029-8653-9f706d488bbe None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:54.526495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00dffb-1682-4029-8653-9f706d488bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:54.526834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00dffb-1682-4029-8653-9f706d488bbe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:54.535444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00dffb-1682-4029-8653-9f706d488bbe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:54.536932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00dffb-1682-4029-8653-9f706d488bbe None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ff00dffb-1682-4029-8653-9f706d488bbe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:18:54.550814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:54.551805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:54.552749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 546/1092] 10.222.0.59 () {56 vars in 1093 bytes} [Fri Jul 1 16:18:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:18:54.558012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00dffb-1682-4029-8653-9f706d488bbe None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:54.571403 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 547/1093] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:18:54.594932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13e15d-dc28-4e0c-b8ca-2002d19bc65c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:54.653561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:54.656492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00dffb-1682-4029-8653-9f706d488bbe None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:54.689555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7ff4-963e-4ce0-a3c8-ae34eaaf64a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:54.690248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7ff4-963e-4ce0-a3c8-ae34eaaf64a4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:54.690530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7ff4-963e-4ce0-a3c8-ae34eaaf64a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:54.690825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e7ff4-963e-4ce0-a3c8-ae34eaaf64a4 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:54.691670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7ff4-963e-4ce0-a3c8-ae34eaaf64a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:54.691976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7ff4-963e-4ce0-a3c8-ae34eaaf64a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:54.693456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e7ff4-963e-4ce0-a3c8-ae34eaaf64a4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:54.693948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13e15d-dc28-4e0c-b8ca-2002d19bc65c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:54.710185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 547/1094] 10.222.0.59 () {56 vars in 1133 bytes} [Fri Jul 1 16:18:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:54.715985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7ff4-963e-4ce0-a3c8-ae34eaaf64a4 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:54.734554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09be219-4de3-457e-84da-7d2410294623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:54.735326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09be219-4de3-457e-84da-7d2410294623 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:54.735599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09be219-4de3-457e-84da-7d2410294623 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:54.735896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09be219-4de3-457e-84da-7d2410294623 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:54.737841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:54.747803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09be219-4de3-457e-84da-7d2410294623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-f09be219-4de3-457e-84da-7d2410294623 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:18:54.755477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:54.756607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:18:54.757550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:18:54.761094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 548/1095] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:18:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:54.762650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09be219-4de3-457e-84da-7d2410294623 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:54.820693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e7ff4-963e-4ce0-a3c8-ae34eaaf64a4 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:54.855088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f55c4f-3be1-4758-8748-c146f0a012ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:54.855841 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f55c4f-3be1-4758-8748-c146f0a012ac None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:54.856146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f55c4f-3be1-4758-8748-c146f0a012ac None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:54.856403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f55c4f-3be1-4758-8748-c146f0a012ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:54.863826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09be219-4de3-457e-84da-7d2410294623 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:54.883371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:54.898208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b44c1-e7c1-471c-a0e9-300a6b20d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:54.898851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b44c1-e7c1-471c-a0e9-300a6b20d90d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:54.899155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b44c1-e7c1-471c-a0e9-300a6b20d90d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:54.899427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b44c1-e7c1-471c-a0e9-300a6b20d90d None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:54.900172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b44c1-e7c1-471c-a0e9-300a6b20d90d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:54.900477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b44c1-e7c1-471c-a0e9-300a6b20d90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:54.902079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b44c1-e7c1-471c-a0e9-300a6b20d90d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:54.915228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 549/1096] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:54.916280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b44c1-e7c1-471c-a0e9-300a6b20d90d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:54.925578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f55c4f-3be1-4758-8748-c146f0a012ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:54.927049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f55c4f-3be1-4758-8748-c146f0a012ac None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:54.970082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:55.016162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b44c1-e7c1-471c-a0e9-300a6b20d90d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:55.026887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 548/1097] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:18:55.033396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f55c4f-3be1-4758-8748-c146f0a012ac None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:55.051267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b421a-655d-4e43-9c22-1dfef55f8fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:55.052141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b421a-655d-4e43-9c22-1dfef55f8fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:55.052411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b421a-655d-4e43-9c22-1dfef55f8fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:55.052674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b421a-655d-4e43-9c22-1dfef55f8fe4 None admin] PATH_INFO: `/v3/users/83d16ff9e77d4e1e9a907f6ca477367a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:55.053890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b421a-655d-4e43-9c22-1dfef55f8fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=83d16ff9e77d4e1e9a907f6ca477367a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:55.055324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0b421a-655d-4e43-9c22-1dfef55f8fe4 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:55.057157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 550/1098] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:18:54 2022] GET /identity/v3/users/83d16ff9e77d4e1e9a907f6ca477367a => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:55.062739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b421a-655d-4e43-9c22-1dfef55f8fe4 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:55.089137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:55.130869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f55c4f-3be1-4758-8748-c146f0a012ac None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:55.163487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0b421a-655d-4e43-9c22-1dfef55f8fe4 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:55.165862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2959ef8-e33c-4330-97cd-0065f7e5124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:55.166605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2959ef8-e33c-4330-97cd-0065f7e5124a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:55.166907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2959ef8-e33c-4330-97cd-0065f7e5124a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:55.167181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2959ef8-e33c-4330-97cd-0065f7e5124a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:55.177044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2959ef8-e33c-4330-97cd-0065f7e5124a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:55.178506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2959ef8-e33c-4330-97cd-0065f7e5124a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:55.186075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b2959ef8-e33c-4330-97cd-0065f7e5124a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:18:55.196511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:55.197491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:55.198550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:18:55.198550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:18:55.198550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:18:55.198550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:55.198785 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0c346-f6b5-422a-9052-0c81867cc64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:55.198874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 549/1099] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:55.198944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0c346-f6b5-422a-9052-0c81867cc64a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:55.198944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0c346-f6b5-422a-9052-0c81867cc64a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:55.198944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0c346-f6b5-422a-9052-0c81867cc64a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:55.203510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2959ef8-e33c-4330-97cd-0065f7e5124a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:55.267847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0c346-f6b5-422a-9052-0c81867cc64a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:55.269345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0c346-f6b5-422a-9052-0c81867cc64a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:55.304265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2959ef8-e33c-4330-97cd-0065f7e5124a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:55.314730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:55.338737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7426ca-6984-4c7e-ad37-16e03f7e33f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:55.339431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7426ca-6984-4c7e-ad37-16e03f7e33f2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:55.339712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7426ca-6984-4c7e-ad37-16e03f7e33f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:55.339983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7426ca-6984-4c7e-ad37-16e03f7e33f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:55.340702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7426ca-6984-4c7e-ad37-16e03f7e33f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:55.341054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7426ca-6984-4c7e-ad37-16e03f7e33f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:55.342431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7426ca-6984-4c7e-ad37-16e03f7e33f2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:55.354117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 550/1100] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:55.359841 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7426ca-6984-4c7e-ad37-16e03f7e33f2 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:55.373542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 551/1101] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:18:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 16:18:55.374710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0c346-f6b5-422a-9052-0c81867cc64a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:55.399622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:55.458030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7426ca-6984-4c7e-ad37-16e03f7e33f2 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:55.472372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0c346-f6b5-422a-9052-0c81867cc64a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:55.492530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e99774-4c95-49c6-aada-aa4138600009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:55.493362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e99774-4c95-49c6-aada-aa4138600009 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:55.493641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e99774-4c95-49c6-aada-aa4138600009 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:55.493913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e99774-4c95-49c6-aada-aa4138600009 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:55.500412 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e99774-4c95-49c6-aada-aa4138600009 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:55.501902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e99774-4c95-49c6-aada-aa4138600009 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:55.504935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdb3e1-80df-4609-a7ec-6ae9d4b7ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:55.505796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdb3e1-80df-4609-a7ec-6ae9d4b7ab98 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:55.506079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdb3e1-80df-4609-a7ec-6ae9d4b7ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:55.506355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfdb3e1-80df-4609-a7ec-6ae9d4b7ab98 None admin] PATH_INFO: `/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:55.507514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdb3e1-80df-4609-a7ec-6ae9d4b7ab98 None admin] RBAC: Authorizing `identity:get_project(project_id=4ef97a8a43a24c04a310b06b4f64a2ca)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:55.508998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfdb3e1-80df-4609-a7ec-6ae9d4b7ab98 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:55.510942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 552/1102] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:18:55 2022] GET /identity/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-06e99774-4c95-49c6-aada-aa4138600009 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:18:55.516017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:18:55.516966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:18:55.517955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:18:55.517955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:18:55.517955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:18:55.517955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:18:55.517955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:18:55.517955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:18:55.517955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:18:55.517955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:18:55.518572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdb3e1-80df-4609-a7ec-6ae9d4b7ab98 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:55.518644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 551/1103] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:18:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:18:55.522773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e99774-4c95-49c6-aada-aa4138600009 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:55.553999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:55.611022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:55.619744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfdb3e1-80df-4609-a7ec-6ae9d4b7ab98 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:55.625011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e99774-4c95-49c6-aada-aa4138600009 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:55.655846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03165d-50ca-48aa-b3fa-197e5051ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:55.656490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03165d-50ca-48aa-b3fa-197e5051ec03 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:55.656767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03165d-50ca-48aa-b3fa-197e5051ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:55.657070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03165d-50ca-48aa-b3fa-197e5051ec03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:55.657898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03165d-50ca-48aa-b3fa-197e5051ec03 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=4ef97a8a43a24c04a310b06b4f64a2ca, user.id=83d16ff9e77d4e1e9a907f6ca477367a) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:55.658208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03165d-50ca-48aa-b3fa-197e5051ec03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:55.659640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03165d-50ca-48aa-b3fa-197e5051ec03 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:55.662334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50155704-3175-40c9-877e-96b1bebd0fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:55.663013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50155704-3175-40c9-877e-96b1bebd0fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:55.663313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50155704-3175-40c9-877e-96b1bebd0fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:55.663573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50155704-3175-40c9-877e-96b1bebd0fa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:55.664362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50155704-3175-40c9-877e-96b1bebd0fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:55.664673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50155704-3175-40c9-877e-96b1bebd0fa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:55.665411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 553/1104] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:55 2022] GET /identity/v3/role_assignments?user.id=83d16ff9e77d4e1e9a907f6ca477367a&scope.project.id=4ef97a8a43a24c04a310b06b4f64a2ca&role.id=842af9e8967047df873d061df391e820 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:18:55.666156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50155704-3175-40c9-877e-96b1bebd0fa1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:55.685018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 552/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:18:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:55.686437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03165d-50ca-48aa-b3fa-197e5051ec03 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:55.804818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03165d-50ca-48aa-b3fa-197e5051ec03 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:55.843342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8f70f-8d08-49c4-9c3c-e5d7dc828ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:55.843989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8f70f-8d08-49c4-9c3c-e5d7dc828ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:55.844271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8f70f-8d08-49c4-9c3c-e5d7dc828ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:55.844542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8f70f-8d08-49c4-9c3c-e5d7dc828ff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:55.845411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8f70f-8d08-49c4-9c3c-e5d7dc828ff0 None admin] RBAC: Adding query filter params (role.id=f0bf50799b744d459a9f485d4c1f45b7, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=efdfb91ba4c04452ba547baa184185c4) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:18:55.845740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8f70f-8d08-49c4-9c3c-e5d7dc828ff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:55.847178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8f70f-8d08-49c4-9c3c-e5d7dc828ff0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:55.853186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 554/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:18:55 2022] GET /identity/v3/role_assignments?user.id=efdfb91ba4c04452ba547baa184185c4&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=f0bf50799b744d459a9f485d4c1f45b7 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:57.720892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c5be-8e4d-4f00-915f-48a85ba6932a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:57.721741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c5be-8e4d-4f00-915f-48a85ba6932a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:57.721741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146c5be-8e4d-4f00-915f-48a85ba6932a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:57.724013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 553/1107] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:18:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:18:57.729820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d51e3-d8b7-474e-b233-7448023c53fc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:57.730255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d51e3-d8b7-474e-b233-7448023c53fc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:57.730347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d51e3-d8b7-474e-b233-7448023c53fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:57.749568 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-756d51e3-d8b7-474e-b233-7448023c53fc None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:18:57.751105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-756d51e3-d8b7-474e-b233-7448023c53fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:18:57.769998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:57.824321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 555/1108] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:18:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:18:57.849497 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c5be-8e4d-4f00-915f-48a85ba6932a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:57.955740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:18:57.967654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146c5be-8e4d-4f00-915f-48a85ba6932a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:58.010537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c378c4b-4589-4ac7-b29f-b1cac8420c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:58.011688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378c4b-4589-4ac7-b29f-b1cac8420c2f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:58.012156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378c4b-4589-4ac7-b29f-b1cac8420c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:58.012605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c378c4b-4589-4ac7-b29f-b1cac8420c2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:58.014851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c378c4b-4589-4ac7-b29f-b1cac8420c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:58.017306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c378c4b-4589-4ac7-b29f-b1cac8420c2f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:58.019948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 554/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:18:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:18:58.026672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d51e3-d8b7-474e-b233-7448023c53fc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:18:58.130020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d51e3-d8b7-474e-b233-7448023c53fc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:18:58.165250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff44eaf-d8d9-499b-ad54-1f461f762a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:18:58.165913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff44eaf-d8d9-499b-ad54-1f461f762a50 None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:18:58.166195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff44eaf-d8d9-499b-ad54-1f461f762a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:18:58.166467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff44eaf-d8d9-499b-ad54-1f461f762a50 None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:18:58.167195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff44eaf-d8d9-499b-ad54-1f461f762a50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:18:58.168694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff44eaf-d8d9-499b-ad54-1f461f762a50 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:18:58.193063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 556/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:18:58 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:19:00.213401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511408-0eef-419b-b51b-28777d6d2e40 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:00.214316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511408-0eef-419b-b51b-28777d6d2e40 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:00.214316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14511408-0eef-419b-b51b-28777d6d2e40 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:00.216493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 555/1111] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:00.225473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f937d69-831e-42d3-a232-20486ad146b5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:00.225880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f937d69-831e-42d3-a232-20486ad146b5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:00.226090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f937d69-831e-42d3-a232-20486ad146b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:00.245610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:00.251699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1f937d69-831e-42d3-a232-20486ad146b5 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:00.254411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1f937d69-831e-42d3-a232-20486ad146b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:00.327353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 557/1112] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:00.351714 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14511408-0eef-419b-b51b-28777d6d2e40 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:00.473772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14511408-0eef-419b-b51b-28777d6d2e40 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:00.518661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f98513-1a7f-4e20-9f68-66915629b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:00.519925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f98513-1a7f-4e20-9f68-66915629b738 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:00.520316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f98513-1a7f-4e20-9f68-66915629b738 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:00.520742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f98513-1a7f-4e20-9f68-66915629b738 None admin] PATH_INFO: `/v3/roles/a97ad9c1458d4bf3a071884c10cae46c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:00.523157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f98513-1a7f-4e20-9f68-66915629b738 None admin] RBAC: Authorizing `identity:get_role(role_id=a97ad9c1458d4bf3a071884c10cae46c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:00.525352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f98513-1a7f-4e20-9f68-66915629b738 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:00.527104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 556/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:00 2022] GET /identity/v3/roles/a97ad9c1458d4bf3a071884c10cae46c => generated 223 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:00.533238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f937d69-831e-42d3-a232-20486ad146b5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:00.652407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f937d69-831e-42d3-a232-20486ad146b5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:00.687597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e4ee3-b7a2-4a20-a707-3a0e56e5a3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:00.688459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4ee3-b7a2-4a20-a707-3a0e56e5a3fe None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:00.688741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4ee3-b7a2-4a20-a707-3a0e56e5a3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:00.689046 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e4ee3-b7a2-4a20-a707-3a0e56e5a3fe None admin] PATH_INFO: `/v3/users/fa87479c1b98478aab97ae1d7f27883a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:00.692059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:00.703253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e4ee3-b7a2-4a20-a707-3a0e56e5a3fe None admin] RBAC: Authorizing `identity:get_user(user_id=fa87479c1b98478aab97ae1d7f27883a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:00.704697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e4ee3-b7a2-4a20-a707-3a0e56e5a3fe None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:00.706405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 558/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:00 2022] GET /identity/v3/users/fa87479c1b98478aab97ae1d7f27883a => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:00.712435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f98513-1a7f-4e20-9f68-66915629b738 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:00.743977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:00.818531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f98513-1a7f-4e20-9f68-66915629b738 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:00.854752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db3112-57f7-423f-87d8-48abd0e62ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:00.855388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db3112-57f7-423f-87d8-48abd0e62ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:00.855666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db3112-57f7-423f-87d8-48abd0e62ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:00.855939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db3112-57f7-423f-87d8-48abd0e62ef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:00.927291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db3112-57f7-423f-87d8-48abd0e62ef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:00.928736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db3112-57f7-423f-87d8-48abd0e62ef1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:00.958030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:01.053252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 557/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:19:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:19:01.062696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e4ee3-b7a2-4a20-a707-3a0e56e5a3fe None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:01.184373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e4ee3-b7a2-4a20-a707-3a0e56e5a3fe None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:01.220146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6bdb5-7bd6-41d5-9cba-de73bdba7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:01.221044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6bdb5-7bd6-41d5-9cba-de73bdba7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:01.221328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6bdb5-7bd6-41d5-9cba-de73bdba7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:01.221605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6bdb5-7bd6-41d5-9cba-de73bdba7ea8 None admin] PATH_INFO: `/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:01.222834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6bdb5-7bd6-41d5-9cba-de73bdba7ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=4ef97a8a43a24c04a310b06b4f64a2ca)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:01.224280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6bdb5-7bd6-41d5-9cba-de73bdba7ea8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:01.226032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 559/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:19:01 2022] GET /identity/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:01.232790 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db3112-57f7-423f-87d8-48abd0e62ef1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:01.338584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db3112-57f7-423f-87d8-48abd0e62ef1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:01.367563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:01.377829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8e217-f1d2-47f8-91e0-006078ace173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:01.378485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8e217-f1d2-47f8-91e0-006078ace173 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:01.378762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8e217-f1d2-47f8-91e0-006078ace173 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:01.379044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8e217-f1d2-47f8-91e0-006078ace173 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:01.379874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8e217-f1d2-47f8-91e0-006078ace173 None admin] RBAC: Adding query filter params (role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=4ef97a8a43a24c04a310b06b4f64a2ca, user.id=fa87479c1b98478aab97ae1d7f27883a) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:01.380189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8e217-f1d2-47f8-91e0-006078ace173 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:01.381684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8e217-f1d2-47f8-91e0-006078ace173 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:01.387422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 558/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:19:01 2022] GET /identity/v3/role_assignments?user.id=fa87479c1b98478aab97ae1d7f27883a&scope.project.id=4ef97a8a43a24c04a310b06b4f64a2ca&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:03.385244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fbad9-d5b8-415b-abb3-75cfce96a83f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:03.386265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fbad9-d5b8-415b-abb3-75cfce96a83f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:03.386265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fbad9-d5b8-415b-abb3-75cfce96a83f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:03.388309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 560/1118] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:03.397025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1035f-494f-4616-9eb1-382593af7ac0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:03.397453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1035f-494f-4616-9eb1-382593af7ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:03.397594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1035f-494f-4616-9eb1-382593af7ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:03.418167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-12c1035f-494f-4616-9eb1-382593af7ac0 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:03.419362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-12c1035f-494f-4616-9eb1-382593af7ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:03.502513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 559/1119] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:03.525582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fbad9-d5b8-415b-abb3-75cfce96a83f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:03.605324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:03.645768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fbad9-d5b8-415b-abb3-75cfce96a83f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:03.680318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fab19-2443-428a-bf49-3b81daffad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:03.681203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fab19-2443-428a-bf49-3b81daffad8b None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:03.681477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fab19-2443-428a-bf49-3b81daffad8b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:03.681747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fab19-2443-428a-bf49-3b81daffad8b None admin] PATH_INFO: `/v3/roles/a97ad9c1458d4bf3a071884c10cae46c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:03.683301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fab19-2443-428a-bf49-3b81daffad8b None admin] RBAC: Authorizing `identity:get_role(role_id=a97ad9c1458d4bf3a071884c10cae46c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:03.684671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fab19-2443-428a-bf49-3b81daffad8b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:03.686085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 561/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:03 2022] GET /identity/v3/roles/a97ad9c1458d4bf3a071884c10cae46c => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:03.692264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1035f-494f-4616-9eb1-382593af7ac0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:03.793707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1035f-494f-4616-9eb1-382593af7ac0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:03.813876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:03.831837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de559f0-8e8f-486a-9269-419771c32a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:03.832717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de559f0-8e8f-486a-9269-419771c32a37 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:03.833039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de559f0-8e8f-486a-9269-419771c32a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:03.833315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de559f0-8e8f-486a-9269-419771c32a37 None admin] PATH_INFO: `/v3/users/fa87479c1b98478aab97ae1d7f27883a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:03.834573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de559f0-8e8f-486a-9269-419771c32a37 None admin] RBAC: Authorizing `identity:get_user(user_id=fa87479c1b98478aab97ae1d7f27883a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:03.836039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de559f0-8e8f-486a-9269-419771c32a37 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:03.837729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 560/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:03 2022] GET /identity/v3/users/fa87479c1b98478aab97ae1d7f27883a => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:19:03.843790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fab19-2443-428a-bf49-3b81daffad8b None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:03.947444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fab19-2443-428a-bf49-3b81daffad8b None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:03.978076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:03.985205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56cae9-90f5-4d13-983e-34cf26206825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:03.986035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56cae9-90f5-4d13-983e-34cf26206825 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:03.986315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56cae9-90f5-4d13-983e-34cf26206825 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:03.986599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56cae9-90f5-4d13-983e-34cf26206825 None admin] PATH_INFO: `/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:03.987834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56cae9-90f5-4d13-983e-34cf26206825 None admin] RBAC: Authorizing `identity:get_project(project_id=4ef97a8a43a24c04a310b06b4f64a2ca)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:03.989302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56cae9-90f5-4d13-983e-34cf26206825 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:03.990989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 562/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:19:03 2022] GET /identity/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:03.997803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de559f0-8e8f-486a-9269-419771c32a37 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:04.106696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de559f0-8e8f-486a-9269-419771c32a37 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:04.143137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a569c-0785-4be2-87e9-c8c8a51c227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:04.144021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a569c-0785-4be2-87e9-c8c8a51c227c None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:04.144303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a569c-0785-4be2-87e9-c8c8a51c227c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:04.144577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a569c-0785-4be2-87e9-c8c8a51c227c None admin] PATH_INFO: `/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca/users/fa87479c1b98478aab97ae1d7f27883a/roles/a97ad9c1458d4bf3a071884c10cae46c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:04.147221 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a569c-0785-4be2-87e9-c8c8a51c227c None admin] RBAC: Authorizing `identity:create_grant(project_id=4ef97a8a43a24c04a310b06b4f64a2ca, user_id=fa87479c1b98478aab97ae1d7f27883a, role_id=a97ad9c1458d4bf3a071884c10cae46c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:04.148673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a569c-0785-4be2-87e9-c8c8a51c227c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:04.164113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 561/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:19:03 2022] PUT /identity/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca/users/fa87479c1b98478aab97ae1d7f27883a/roles/a97ad9c1458d4bf3a071884c10cae46c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:19:06.171441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a8ea-ffde-4f44-ad84-8c3b0aeb9474 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:06.172336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a8ea-ffde-4f44-ad84-8c3b0aeb9474 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:06.172336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5a8ea-ffde-4f44-ad84-8c3b0aeb9474 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:06.174635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 563/1124] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:06.181001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b346488-c383-4a73-81fb-a88404eedc24 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:06.181946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b346488-c383-4a73-81fb-a88404eedc24 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:06.181946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b346488-c383-4a73-81fb-a88404eedc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:06.199727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4b346488-c383-4a73-81fb-a88404eedc24 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:06.200982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4b346488-c383-4a73-81fb-a88404eedc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:06.247818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:06.284327 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 562/1125] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:06.308909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a8ea-ffde-4f44-ad84-8c3b0aeb9474 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:06.425296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5a8ea-ffde-4f44-ad84-8c3b0aeb9474 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:06.459989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c80ba5-2141-426c-b9ed-26c564d1bcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:06.460829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80ba5-2141-426c-b9ed-26c564d1bcac None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:06.461139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80ba5-2141-426c-b9ed-26c564d1bcac None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:06.461406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c80ba5-2141-426c-b9ed-26c564d1bcac None admin] PATH_INFO: `/v3/roles/a97ad9c1458d4bf3a071884c10cae46c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:06.462988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c80ba5-2141-426c-b9ed-26c564d1bcac None admin] RBAC: Authorizing `identity:get_role(role_id=a97ad9c1458d4bf3a071884c10cae46c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:06.464422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c80ba5-2141-426c-b9ed-26c564d1bcac None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:06.465840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 564/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:06 2022] GET /identity/v3/roles/a97ad9c1458d4bf3a071884c10cae46c => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:06.471993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b346488-c383-4a73-81fb-a88404eedc24 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:06.580772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b346488-c383-4a73-81fb-a88404eedc24 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:06.616267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302b35c-92f0-462d-9b8b-83696cf88e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:06.617171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302b35c-92f0-462d-9b8b-83696cf88e55 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:06.617451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302b35c-92f0-462d-9b8b-83696cf88e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:06.617724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302b35c-92f0-462d-9b8b-83696cf88e55 None admin] PATH_INFO: `/v3/users/fa87479c1b98478aab97ae1d7f27883a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:06.618976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302b35c-92f0-462d-9b8b-83696cf88e55 None admin] RBAC: Authorizing `identity:get_user(user_id=fa87479c1b98478aab97ae1d7f27883a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:06.620457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302b35c-92f0-462d-9b8b-83696cf88e55 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:06.622106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 563/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:06 2022] GET /identity/v3/users/fa87479c1b98478aab97ae1d7f27883a => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:06.628372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c80ba5-2141-426c-b9ed-26c564d1bcac None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:06.694055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:06.730007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c80ba5-2141-426c-b9ed-26c564d1bcac None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:06.765202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a0749-2e4a-4820-bea3-aa2b9bc6a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:06.765853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a0749-2e4a-4820-bea3-aa2b9bc6a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:06.766138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a0749-2e4a-4820-bea3-aa2b9bc6a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:06.766412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a0749-2e4a-4820-bea3-aa2b9bc6a3f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:06.836478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a0749-2e4a-4820-bea3-aa2b9bc6a3f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:06.837984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a0749-2e4a-4820-bea3-aa2b9bc6a3f9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:06.907652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:06.947544 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 565/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:19:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:19:06.953890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302b35c-92f0-462d-9b8b-83696cf88e55 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:07.007561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:07.073025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302b35c-92f0-462d-9b8b-83696cf88e55 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:07.113654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612c6eb-d0ea-4f0a-9ad9-58025ab8b922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:07.114519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612c6eb-d0ea-4f0a-9ad9-58025ab8b922 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:07.114793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612c6eb-d0ea-4f0a-9ad9-58025ab8b922 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:07.115062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612c6eb-d0ea-4f0a-9ad9-58025ab8b922 None admin] PATH_INFO: `/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:07.116370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612c6eb-d0ea-4f0a-9ad9-58025ab8b922 None admin] RBAC: Authorizing `identity:get_project(project_id=4ef97a8a43a24c04a310b06b4f64a2ca)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:07.117866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f612c6eb-d0ea-4f0a-9ad9-58025ab8b922 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:07.119616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 564/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:19:06 2022] GET /identity/v3/projects/4ef97a8a43a24c04a310b06b4f64a2ca => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:07.129579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a0749-2e4a-4820-bea3-aa2b9bc6a3f9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:07.239031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a0749-2e4a-4820-bea3-aa2b9bc6a3f9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:07.274061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d0cca-c3eb-4e92-b54f-7d2261237584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:07.274702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d0cca-c3eb-4e92-b54f-7d2261237584 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:07.275028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d0cca-c3eb-4e92-b54f-7d2261237584 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:07.275254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d0cca-c3eb-4e92-b54f-7d2261237584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:07.276173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d0cca-c3eb-4e92-b54f-7d2261237584 None admin] RBAC: Adding query filter params (role.id=a97ad9c1458d4bf3a071884c10cae46c, scope.project.id=4ef97a8a43a24c04a310b06b4f64a2ca, user.id=fa87479c1b98478aab97ae1d7f27883a) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:07.276484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d0cca-c3eb-4e92-b54f-7d2261237584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:07.277953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d0cca-c3eb-4e92-b54f-7d2261237584 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:07.283975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 566/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:19:07 2022] GET /identity/v3/role_assignments?user.id=fa87479c1b98478aab97ae1d7f27883a&scope.project.id=4ef97a8a43a24c04a310b06b4f64a2ca&role.id=a97ad9c1458d4bf3a071884c10cae46c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:19:09.310482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923b30e-8055-4f04-9bb7-3ff9c375613c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:09.311391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923b30e-8055-4f04-9bb7-3ff9c375613c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:09.311391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923b30e-8055-4f04-9bb7-3ff9c375613c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:09.313566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 565/1131] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:09.319836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec1da3-17a7-4cb7-8fd3-16c7b49571c9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:09.320537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec1da3-17a7-4cb7-8fd3-16c7b49571c9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:09.320690 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec1da3-17a7-4cb7-8fd3-16c7b49571c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:09.345852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b4ec1da3-17a7-4cb7-8fd3-16c7b49571c9 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:09.347069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b4ec1da3-17a7-4cb7-8fd3-16c7b49571c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:09.374228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:09.421390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 567/1132] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:09.449512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923b30e-8055-4f04-9bb7-3ff9c375613c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:09.555235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923b30e-8055-4f04-9bb7-3ff9c375613c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:09.570966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:09.592822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef20b849-aece-4973-90d0-d4831dbb95d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:09.593652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b849-aece-4973-90d0-d4831dbb95d7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:09.593931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b849-aece-4973-90d0-d4831dbb95d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:09.594204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20b849-aece-4973-90d0-d4831dbb95d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:09.595412 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20b849-aece-4973-90d0-d4831dbb95d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:09.596889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef20b849-aece-4973-90d0-d4831dbb95d7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:09.598511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 566/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:19:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:09.605894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec1da3-17a7-4cb7-8fd3-16c7b49571c9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:09.719157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec1da3-17a7-4cb7-8fd3-16c7b49571c9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:09.755063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e21a3b-19b8-4cc9-8537-8b08ec9d155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:09.755727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e21a3b-19b8-4cc9-8537-8b08ec9d155b None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:09.756016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e21a3b-19b8-4cc9-8537-8b08ec9d155b None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:09.756282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e21a3b-19b8-4cc9-8537-8b08ec9d155b None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:09.757020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e21a3b-19b8-4cc9-8537-8b08ec9d155b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:09.758481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e21a3b-19b8-4cc9-8537-8b08ec9d155b None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:09.788421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 568/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:19:09 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:19:11.819428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabce86-c330-4e4b-a787-af86950b5b92 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:11.819959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabce86-c330-4e4b-a787-af86950b5b92 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:11.820074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabce86-c330-4e4b-a787-af86950b5b92 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:11.822246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 567/1135] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:11.827869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474c11-b804-4cb4-8dc2-ac4063a83293 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:11.828317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474c11-b804-4cb4-8dc2-ac4063a83293 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:11.828409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474c11-b804-4cb4-8dc2-ac4063a83293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:11.848424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-84474c11-b804-4cb4-8dc2-ac4063a83293 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:11.850378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-84474c11-b804-4cb4-8dc2-ac4063a83293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:11.859345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:11.930348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 569/1136] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:19:11.962034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabce86-c330-4e4b-a787-af86950b5b92 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:12.074567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabce86-c330-4e4b-a787-af86950b5b92 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:12.110168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0ee7d-0a41-4f0e-8bfb-d3ae9ddc24bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:12.110961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0ee7d-0a41-4f0e-8bfb-d3ae9ddc24bb None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:12.111243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0ee7d-0a41-4f0e-8bfb-d3ae9ddc24bb None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:12.111512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0ee7d-0a41-4f0e-8bfb-d3ae9ddc24bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:12.112819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0ee7d-0a41-4f0e-8bfb-d3ae9ddc24bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:12.114313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0ee7d-0a41-4f0e-8bfb-d3ae9ddc24bb None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:12.115915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 568/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:12.122181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474c11-b804-4cb4-8dc2-ac4063a83293 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:12.239016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474c11-b804-4cb4-8dc2-ac4063a83293 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:12.277768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0692729-2472-4e3e-8e92-1814feb153ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:12.278430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692729-2472-4e3e-8e92-1814feb153ca None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:12.278716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692729-2472-4e3e-8e92-1814feb153ca None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:12.278995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0692729-2472-4e3e-8e92-1814feb153ca None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:12.279709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0692729-2472-4e3e-8e92-1814feb153ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:12.281185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0692729-2472-4e3e-8e92-1814feb153ca None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:12.300470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:12.308891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 570/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:19:12 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:19:14.338931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899c56-62f0-43a4-83f1-2fe5fad1f507 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:14.339494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899c56-62f0-43a4-83f1-2fe5fad1f507 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:14.339494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899c56-62f0-43a4-83f1-2fe5fad1f507 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:14.340871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 569/1139] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:14.346316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f80c07-3f39-4dcb-8480-ceb2be120cb7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:14.346747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f80c07-3f39-4dcb-8480-ceb2be120cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:14.346847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f80c07-3f39-4dcb-8480-ceb2be120cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:14.365743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-73f80c07-3f39-4dcb-8480-ceb2be120cb7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:14.366915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-73f80c07-3f39-4dcb-8480-ceb2be120cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:14.444970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 571/1140] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:14.469922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18899c56-62f0-43a4-83f1-2fe5fad1f507 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:14.532986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:14.582654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18899c56-62f0-43a4-83f1-2fe5fad1f507 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:14.617755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb658-fd0a-48de-95b2-fc93c285b971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:14.618476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb658-fd0a-48de-95b2-fc93c285b971 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:14.618807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb658-fd0a-48de-95b2-fc93c285b971 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:14.619028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adb658-fd0a-48de-95b2-fc93c285b971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:14.629616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1adb658-fd0a-48de-95b2-fc93c285b971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c1adb658-fd0a-48de-95b2-fc93c285b971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:19:14.637292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:19:14.638447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:19:14.639707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 570/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:19:14.644550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f80c07-3f39-4dcb-8480-ceb2be120cb7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:14.751389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f80c07-3f39-4dcb-8480-ceb2be120cb7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:14.782371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:14.791626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c491334-1aaa-4698-ad22-e631ea30eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:14.792302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c491334-1aaa-4698-ad22-e631ea30eee2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:14.792584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c491334-1aaa-4698-ad22-e631ea30eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:14.792882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c491334-1aaa-4698-ad22-e631ea30eee2 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:14.793716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c491334-1aaa-4698-ad22-e631ea30eee2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:14.794034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c491334-1aaa-4698-ad22-e631ea30eee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:14.795419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c491334-1aaa-4698-ad22-e631ea30eee2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:14.803751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 572/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:14.810711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb658-fd0a-48de-95b2-fc93c285b971 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:14.920304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adb658-fd0a-48de-95b2-fc93c285b971 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:14.930465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:14.954859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202bbe6-11d3-4030-b273-4c515b7bcad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:14.955734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202bbe6-11d3-4030-b273-4c515b7bcad3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:14.956018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202bbe6-11d3-4030-b273-4c515b7bcad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:14.956280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202bbe6-11d3-4030-b273-4c515b7bcad3 None admin] PATH_INFO: `/v3/users/ea0501bf256d462e9e722584e10ad7ad` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:14.969425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202bbe6-11d3-4030-b273-4c515b7bcad3 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0501bf256d462e9e722584e10ad7ad)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:14.970892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202bbe6-11d3-4030-b273-4c515b7bcad3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:14.972560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 571/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:14 2022] GET /identity/v3/users/ea0501bf256d462e9e722584e10ad7ad => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:14.978876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c491334-1aaa-4698-ad22-e631ea30eee2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:15.092129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c491334-1aaa-4698-ad22-e631ea30eee2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:15.132113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2a535-3648-43cb-a312-6bc3cddaaf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:15.133177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2a535-3648-43cb-a312-6bc3cddaaf08 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:15.133626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2a535-3648-43cb-a312-6bc3cddaaf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:15.134053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2a535-3648-43cb-a312-6bc3cddaaf08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:15.195844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:15.212180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2a535-3648-43cb-a312-6bc3cddaaf08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:15.214027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2a535-3648-43cb-a312-6bc3cddaaf08 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:15.319230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 573/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:19:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:19:15.325850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202bbe6-11d3-4030-b273-4c515b7bcad3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:15.433770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202bbe6-11d3-4030-b273-4c515b7bcad3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:15.472032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5618b-5abe-43e3-a142-28ccdc19808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:15.472818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5618b-5abe-43e3-a142-28ccdc19808a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:15.473124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5618b-5abe-43e3-a142-28ccdc19808a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:15.473391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5618b-5abe-43e3-a142-28ccdc19808a None admin] PATH_INFO: `/v3/projects/a3f40714e22c4cd481079ed370066386` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:15.474685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5618b-5abe-43e3-a142-28ccdc19808a None admin] RBAC: Authorizing `identity:get_project(project_id=a3f40714e22c4cd481079ed370066386)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:15.476126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5618b-5abe-43e3-a142-28ccdc19808a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:15.478199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 572/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:19:15 2022] GET /identity/v3/projects/a3f40714e22c4cd481079ed370066386 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:15.485135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2a535-3648-43cb-a312-6bc3cddaaf08 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:15.576231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:15.586730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2a535-3648-43cb-a312-6bc3cddaaf08 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:15.621361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b701f-5fb2-4b7e-a20d-d488f034b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:15.622009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b701f-5fb2-4b7e-a20d-d488f034b17e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:15.622296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b701f-5fb2-4b7e-a20d-d488f034b17e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:15.622577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b701f-5fb2-4b7e-a20d-d488f034b17e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:15.623401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b701f-5fb2-4b7e-a20d-d488f034b17e None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=a3f40714e22c4cd481079ed370066386, user.id=ea0501bf256d462e9e722584e10ad7ad) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:15.623710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b701f-5fb2-4b7e-a20d-d488f034b17e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:15.625309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b701f-5fb2-4b7e-a20d-d488f034b17e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:15.632068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 574/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:19:15 2022] GET /identity/v3/role_assignments?user.id=ea0501bf256d462e9e722584e10ad7ad&scope.project.id=a3f40714e22c4cd481079ed370066386&role.id=842af9e8967047df873d061df391e820 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:17.608751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2555e-b01d-40ce-adb9-1409d0a54424 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:17.609648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2555e-b01d-40ce-adb9-1409d0a54424 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:17.609648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2555e-b01d-40ce-adb9-1409d0a54424 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:17.611853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 573/1147] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:17.618340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b35f-848b-410c-a6e2-9d2d7e81c588 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:17.618794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b35f-848b-410c-a6e2-9d2d7e81c588 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:17.618887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5b35f-848b-410c-a6e2-9d2d7e81c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:17.636979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-22d5b35f-848b-410c-a6e2-9d2d7e81c588 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:17.638173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-22d5b35f-848b-410c-a6e2-9d2d7e81c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:17.709765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 575/1148] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:17.734656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2555e-b01d-40ce-adb9-1409d0a54424 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:17.775029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:17.845623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2555e-b01d-40ce-adb9-1409d0a54424 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:17.881357 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfc2dd-2af4-492c-b8a3-2201a594e91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:17.882082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfc2dd-2af4-492c-b8a3-2201a594e91f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:17.882361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfc2dd-2af4-492c-b8a3-2201a594e91f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:17.882635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfc2dd-2af4-492c-b8a3-2201a594e91f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:17.893588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfc2dd-2af4-492c-b8a3-2201a594e91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-70dfc2dd-2af4-492c-b8a3-2201a594e91f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:19:17.901248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:19:17.902377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:19:17.903228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 574/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:19:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:19:17.909100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5b35f-848b-410c-a6e2-9d2d7e81c588 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:17.997475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:18.015888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5b35f-848b-410c-a6e2-9d2d7e81c588 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:18.050969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae507e4-7e42-47de-8768-83034b2ecd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:18.051624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae507e4-7e42-47de-8768-83034b2ecd10 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:18.051901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae507e4-7e42-47de-8768-83034b2ecd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:18.052174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae507e4-7e42-47de-8768-83034b2ecd10 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:18.052955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae507e4-7e42-47de-8768-83034b2ecd10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:18.053249 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae507e4-7e42-47de-8768-83034b2ecd10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:18.054649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae507e4-7e42-47de-8768-83034b2ecd10 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:18.062899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 576/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:19:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:18.069592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfc2dd-2af4-492c-b8a3-2201a594e91f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:18.170525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:18.177201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfc2dd-2af4-492c-b8a3-2201a594e91f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:18.212537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4408822-9eed-497a-b605-d54139d17ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:18.213539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4408822-9eed-497a-b605-d54139d17ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:18.213818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4408822-9eed-497a-b605-d54139d17ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:18.214098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4408822-9eed-497a-b605-d54139d17ab3 None admin] PATH_INFO: `/v3/users/ea0501bf256d462e9e722584e10ad7ad` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:18.215379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4408822-9eed-497a-b605-d54139d17ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0501bf256d462e9e722584e10ad7ad)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:18.216832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4408822-9eed-497a-b605-d54139d17ab3 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:18.218506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 575/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:18 2022] GET /identity/v3/users/ea0501bf256d462e9e722584e10ad7ad => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:18.228386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae507e4-7e42-47de-8768-83034b2ecd10 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:18.344166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae507e4-7e42-47de-8768-83034b2ecd10 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:18.379731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a5ca7-fa80-4e7a-ae33-99190d057159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:18.380588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a5ca7-fa80-4e7a-ae33-99190d057159 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:18.380880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a5ca7-fa80-4e7a-ae33-99190d057159 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:18.381166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a5ca7-fa80-4e7a-ae33-99190d057159 None admin] PATH_INFO: `/v3/projects/a3f40714e22c4cd481079ed370066386` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:18.382450 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a5ca7-fa80-4e7a-ae33-99190d057159 None admin] RBAC: Authorizing `identity:get_project(project_id=a3f40714e22c4cd481079ed370066386)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:18.383882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a5ca7-fa80-4e7a-ae33-99190d057159 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:18.385683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 577/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:19:18 2022] GET /identity/v3/projects/a3f40714e22c4cd481079ed370066386 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:18.392497 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4408822-9eed-497a-b605-d54139d17ab3 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:18.507411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4408822-9eed-497a-b605-d54139d17ab3 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:18.542111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2c99a-4910-4440-b4bd-3fefb3c116ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:18.543005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2c99a-4910-4440-b4bd-3fefb3c116ed None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:18.543286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2c99a-4910-4440-b4bd-3fefb3c116ed None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:18.543560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2c99a-4910-4440-b4bd-3fefb3c116ed None admin] PATH_INFO: `/v3/projects/a3f40714e22c4cd481079ed370066386/users/ea0501bf256d462e9e722584e10ad7ad/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:18.545640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2c99a-4910-4440-b4bd-3fefb3c116ed None admin] RBAC: Authorizing `identity:create_grant(project_id=a3f40714e22c4cd481079ed370066386, user_id=ea0501bf256d462e9e722584e10ad7ad, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:18.547085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2c99a-4910-4440-b4bd-3fefb3c116ed None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:18.566315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 576/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:19:18 2022] PUT /identity/v3/projects/a3f40714e22c4cd481079ed370066386/users/ea0501bf256d462e9e722584e10ad7ad/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:19:20.536057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896640e3-6c09-4a8d-8aea-a3f96a635d82 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:20.536904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896640e3-6c09-4a8d-8aea-a3f96a635d82 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:20.536904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896640e3-6c09-4a8d-8aea-a3f96a635d82 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:20.539176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 578/1154] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:20.545428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378c71b-6ade-4c33-b2cb-67ea67965542 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:20.545860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378c71b-6ade-4c33-b2cb-67ea67965542 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:20.545949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378c71b-6ade-4c33-b2cb-67ea67965542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:20.566862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d378c71b-6ade-4c33-b2cb-67ea67965542 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:20.568104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d378c71b-6ade-4c33-b2cb-67ea67965542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:20.588912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:20.655504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 577/1155] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:20.679149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896640e3-6c09-4a8d-8aea-a3f96a635d82 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:20.698294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:20.788569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896640e3-6c09-4a8d-8aea-a3f96a635d82 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:20.823455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ff402-4932-445e-94e9-d9bdc92504e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:20.824240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff402-4932-445e-94e9-d9bdc92504e6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:20.824517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff402-4932-445e-94e9-d9bdc92504e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:20.824789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ff402-4932-445e-94e9-d9bdc92504e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:20.836028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ff402-4932-445e-94e9-d9bdc92504e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-d12ff402-4932-445e-94e9-d9bdc92504e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:19:20.843648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:19:20.844693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:19:20.846000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 579/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:19:20.854752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378c71b-6ade-4c33-b2cb-67ea67965542 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:20.957919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378c71b-6ade-4c33-b2cb-67ea67965542 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:20.993402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dc037-7b03-4af0-ad97-5473c2b50add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:20.994061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dc037-7b03-4af0-ad97-5473c2b50add None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:20.994340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dc037-7b03-4af0-ad97-5473c2b50add None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:20.994609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419dc037-7b03-4af0-ad97-5473c2b50add None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:20.995386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dc037-7b03-4af0-ad97-5473c2b50add None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:20.995698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dc037-7b03-4af0-ad97-5473c2b50add None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:20.997097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419dc037-7b03-4af0-ad97-5473c2b50add None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:21.005218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 578/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:21.011183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ff402-4932-445e-94e9-d9bdc92504e6 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:21.086217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:21.115327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ff402-4932-445e-94e9-d9bdc92504e6 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:21.149420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003ef0-a72f-4679-bbed-302825c5cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:21.150271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003ef0-a72f-4679-bbed-302825c5cae9 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:21.150546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003ef0-a72f-4679-bbed-302825c5cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:21.150821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3003ef0-a72f-4679-bbed-302825c5cae9 None admin] PATH_INFO: `/v3/users/ea0501bf256d462e9e722584e10ad7ad` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:21.152355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3003ef0-a72f-4679-bbed-302825c5cae9 None admin] RBAC: Authorizing `identity:get_user(user_id=ea0501bf256d462e9e722584e10ad7ad)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:21.153594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3003ef0-a72f-4679-bbed-302825c5cae9 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:21.155278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 580/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:21 2022] GET /identity/v3/users/ea0501bf256d462e9e722584e10ad7ad => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:21.161315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dc037-7b03-4af0-ad97-5473c2b50add None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:21.180725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:21.292032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419dc037-7b03-4af0-ad97-5473c2b50add None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:21.327525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22e823-44df-4e25-81a1-22211669ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:21.328198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22e823-44df-4e25-81a1-22211669ecca None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:21.328477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22e823-44df-4e25-81a1-22211669ecca None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:21.328752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22e823-44df-4e25-81a1-22211669ecca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:21.418198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22e823-44df-4e25-81a1-22211669ecca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:21.419584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22e823-44df-4e25-81a1-22211669ecca None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:21.436349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:21.519668 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 579/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:19:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:19:21.525848 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003ef0-a72f-4679-bbed-302825c5cae9 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:21.635015 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3003ef0-a72f-4679-bbed-302825c5cae9 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:21.670285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c6d4c-f52e-4efd-aef7-28e802b284cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:21.671065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6d4c-f52e-4efd-aef7-28e802b284cd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:21.671340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6d4c-f52e-4efd-aef7-28e802b284cd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:21.671611 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c6d4c-f52e-4efd-aef7-28e802b284cd None admin] PATH_INFO: `/v3/projects/a3f40714e22c4cd481079ed370066386` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:21.672879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c6d4c-f52e-4efd-aef7-28e802b284cd None admin] RBAC: Authorizing `identity:get_project(project_id=a3f40714e22c4cd481079ed370066386)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:21.674312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c6d4c-f52e-4efd-aef7-28e802b284cd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:21.676000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 581/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:19:21 2022] GET /identity/v3/projects/a3f40714e22c4cd481079ed370066386 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:19:21.682391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22e823-44df-4e25-81a1-22211669ecca None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:21.789716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22e823-44df-4e25-81a1-22211669ecca None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:21.806529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:21.825160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ed65e-948a-422b-af8b-86087517d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:21.825821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ed65e-948a-422b-af8b-86087517d779 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:21.826102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ed65e-948a-422b-af8b-86087517d779 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:21.826376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ed65e-948a-422b-af8b-86087517d779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:21.827190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ed65e-948a-422b-af8b-86087517d779 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=a3f40714e22c4cd481079ed370066386, user.id=ea0501bf256d462e9e722584e10ad7ad) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:21.827503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ed65e-948a-422b-af8b-86087517d779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:21.829009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ed65e-948a-422b-af8b-86087517d779 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:21.834927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 580/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:19:21 2022] GET /identity/v3/role_assignments?user.id=ea0501bf256d462e9e722584e10ad7ad&scope.project.id=a3f40714e22c4cd481079ed370066386&role.id=842af9e8967047df873d061df391e820 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:23.862942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b62d-f2d4-45df-86c5-c1dbb04111cf None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:23.863485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b62d-f2d4-45df-86c5-c1dbb04111cf None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:23.863485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b62d-f2d4-45df-86c5-c1dbb04111cf None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:23.864891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 582/1162] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:23.870400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e447e9-37bf-4ab7-b227-8a0ff62f7b7b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:23.870851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e447e9-37bf-4ab7-b227-8a0ff62f7b7b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:23.870946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e447e9-37bf-4ab7-b227-8a0ff62f7b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:23.889346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e8e447e9-37bf-4ab7-b227-8a0ff62f7b7b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:23.890565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e8e447e9-37bf-4ab7-b227-8a0ff62f7b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:23.959940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 581/1163] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:23.993420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b62d-f2d4-45df-86c5-c1dbb04111cf None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:24.014298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:24.110029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b62d-f2d4-45df-86c5-c1dbb04111cf None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:24.145187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e0f7f-e54d-4a31-9002-8c8dc3478f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:24.145828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e0f7f-e54d-4a31-9002-8c8dc3478f0f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:24.146113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e0f7f-e54d-4a31-9002-8c8dc3478f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:24.146389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e0f7f-e54d-4a31-9002-8c8dc3478f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:24.214356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e0f7f-e54d-4a31-9002-8c8dc3478f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:24.215855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e0f7f-e54d-4a31-9002-8c8dc3478f0f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:24.226898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:24.336433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 583/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:19:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:19:24.343314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e447e9-37bf-4ab7-b227-8a0ff62f7b7b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:24.452467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e447e9-37bf-4ab7-b227-8a0ff62f7b7b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:24.464050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:24.502346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e0e1e-52e4-4ca0-bbc8-0b0b7ab0a634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:24.503154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e0e1e-52e4-4ca0-bbc8-0b0b7ab0a634 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:24.503459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e0e1e-52e4-4ca0-bbc8-0b0b7ab0a634 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:24.503734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e0e1e-52e4-4ca0-bbc8-0b0b7ab0a634 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:24.510688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e0e1e-52e4-4ca0-bbc8-0b0b7ab0a634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:24.512193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e0e1e-52e4-4ca0-bbc8-0b0b7ab0a634 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-269e0e1e-52e4-4ca0-bbc8-0b0b7ab0a634 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:19:24.526387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:19:24.527645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:19:24.528524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 582/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:19:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:19:24.535847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e0f7f-e54d-4a31-9002-8c8dc3478f0f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:24.643322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e0f7f-e54d-4a31-9002-8c8dc3478f0f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:24.654929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:24.682249 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024567e-48e5-4adf-8905-a61218b454a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:24.682912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024567e-48e5-4adf-8905-a61218b454a6 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:24.683185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024567e-48e5-4adf-8905-a61218b454a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:24.683456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024567e-48e5-4adf-8905-a61218b454a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:24.684165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024567e-48e5-4adf-8905-a61218b454a6 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:24.684461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024567e-48e5-4adf-8905-a61218b454a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:24.685861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024567e-48e5-4adf-8905-a61218b454a6 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:24.693583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 584/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Fri Jul 1 16:19:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:26.699323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b1e9a-91ef-49ae-a6a7-7942123f140b None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:26.699888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b1e9a-91ef-49ae-a6a7-7942123f140b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:26.699888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b1e9a-91ef-49ae-a6a7-7942123f140b None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:26.701294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 583/1167] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:26.707637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1eac-6f77-4688-87a4-e46efce8b67e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:26.708340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1eac-6f77-4688-87a4-e46efce8b67e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:26.708483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef1eac-6f77-4688-87a4-e46efce8b67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:26.729785 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3fef1eac-6f77-4688-87a4-e46efce8b67e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:26.731154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3fef1eac-6f77-4688-87a4-e46efce8b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:26.805102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 585/1168] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:26.836038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b1e9a-91ef-49ae-a6a7-7942123f140b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:26.960666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b1e9a-91ef-49ae-a6a7-7942123f140b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:27.004544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9117da-ec95-4d5d-ac49-e3e61596fffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:27.005243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9117da-ec95-4d5d-ac49-e3e61596fffc None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:27.005525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9117da-ec95-4d5d-ac49-e3e61596fffc None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:27.005805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9117da-ec95-4d5d-ac49-e3e61596fffc None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:27.006553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9117da-ec95-4d5d-ac49-e3e61596fffc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:27.007948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9117da-ec95-4d5d-ac49-e3e61596fffc None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:27.025831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 584/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Fri Jul 1 16:19:26 2022] POST /identity/v3/domains => generated 267 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:19:29.042387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b88e8-7284-49bd-9280-a5e6eda3a1a6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:29.042934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b88e8-7284-49bd-9280-a5e6eda3a1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:29.042934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b88e8-7284-49bd-9280-a5e6eda3a1a6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:29.044233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 586/1170] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:29.050592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcfb4b-d9b8-4907-88e8-f358bfae05b6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:29.051321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcfb4b-d9b8-4907-88e8-f358bfae05b6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:29.051626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fcfb4b-d9b8-4907-88e8-f358bfae05b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:29.077796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b7fcfb4b-d9b8-4907-88e8-f358bfae05b6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:29.079004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b7fcfb4b-d9b8-4907-88e8-f358bfae05b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:29.103781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:29.159437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 585/1171] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:29.183383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b88e8-7284-49bd-9280-a5e6eda3a1a6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:29.296833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b88e8-7284-49bd-9280-a5e6eda3a1a6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:29.299673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:29.342923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8fb91-df05-4619-b103-ae641b629d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:29.343777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8fb91-df05-4619-b103-ae641b629d5d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:29.344059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8fb91-df05-4619-b103-ae641b629d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:29.344328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8fb91-df05-4619-b103-ae641b629d5d None admin] PATH_INFO: `/v3/domains/f8db1b035ad84056a7803047cb189a4c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:29.355713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8fb91-df05-4619-b103-ae641b629d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8db1b035ad84056a7803047cb189a4c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:29.357209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8fb91-df05-4619-b103-ae641b629d5d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:29.358861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 587/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Fri Jul 1 16:19:29 2022] GET /identity/v3/domains/f8db1b035ad84056a7803047cb189a4c => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:29.365229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcfb4b-d9b8-4907-88e8-f358bfae05b6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:29.465480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fcfb4b-d9b8-4907-88e8-f358bfae05b6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:29.504660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5b460-db1d-42ee-8a8a-dfc29b71d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:29.505341 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b460-db1d-42ee-8a8a-dfc29b71d0b6 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:29.505620 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b460-db1d-42ee-8a8a-dfc29b71d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:29.505892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b460-db1d-42ee-8a8a-dfc29b71d0b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:29.506604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5b460-db1d-42ee-8a8a-dfc29b71d0b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:29.508049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5b460-db1d-42ee-8a8a-dfc29b71d0b6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:29.540989 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 586/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:19:29 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:19:31.607346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1864d-71e2-4b58-a3ea-31a35d6bcd08 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:31.608208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1864d-71e2-4b58-a3ea-31a35d6bcd08 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:31.608208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1864d-71e2-4b58-a3ea-31a35d6bcd08 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:31.610437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 588/1174] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:31.618382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1549f7-c361-4387-bc01-77bef25ba496 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:31.618811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1549f7-c361-4387-bc01-77bef25ba496 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:31.618899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1549f7-c361-4387-bc01-77bef25ba496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:31.637875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0e1549f7-c361-4387-bc01-77bef25ba496 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:31.639149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0e1549f7-c361-4387-bc01-77bef25ba496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:31.646389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:31.709159 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 587/1175] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:19:31.734720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1864d-71e2-4b58-a3ea-31a35d6bcd08 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:31.854799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1864d-71e2-4b58-a3ea-31a35d6bcd08 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:31.891692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea46976d-8bff-46be-a154-f49573a5366f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:31.892498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46976d-8bff-46be-a154-f49573a5366f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:31.892782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46976d-8bff-46be-a154-f49573a5366f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:31.893086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea46976d-8bff-46be-a154-f49573a5366f None admin] PATH_INFO: `/v3/domains/f8db1b035ad84056a7803047cb189a4c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:31.894404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46976d-8bff-46be-a154-f49573a5366f None admin] RBAC: Authorizing `identity:get_domain(domain_id=f8db1b035ad84056a7803047cb189a4c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:31.895924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea46976d-8bff-46be-a154-f49573a5366f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:31.897504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 589/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Fri Jul 1 16:19:31 2022] GET /identity/v3/domains/f8db1b035ad84056a7803047cb189a4c => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:31.903643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1549f7-c361-4387-bc01-77bef25ba496 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:32.014864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1549f7-c361-4387-bc01-77bef25ba496 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:32.053173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b7b80-ea29-4ad8-9f40-c418501bd099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:32.053834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b7b80-ea29-4ad8-9f40-c418501bd099 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:32.054110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b7b80-ea29-4ad8-9f40-c418501bd099 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:32.054376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b7b80-ea29-4ad8-9f40-c418501bd099 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:32.055074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b7b80-ea29-4ad8-9f40-c418501bd099 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:32.056519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b7b80-ea29-4ad8-9f40-c418501bd099 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:32.075011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:32.081191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 588/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:19:31 2022] POST /identity/v3/users => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:19:34.124549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f38c7-c9f3-43ab-b928-c45cfbb04e0b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:34.125599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f38c7-c9f3-43ab-b928-c45cfbb04e0b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:34.125599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f38c7-c9f3-43ab-b928-c45cfbb04e0b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:34.127722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 590/1178] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:34.134023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7431e68-9524-4fe1-807d-6d791dc5443a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:34.134766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7431e68-9524-4fe1-807d-6d791dc5443a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:34.134973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7431e68-9524-4fe1-807d-6d791dc5443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:34.164234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f7431e68-9524-4fe1-807d-6d791dc5443a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:34.166277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f7431e68-9524-4fe1-807d-6d791dc5443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:34.239891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 589/1179] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:34.263657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f38c7-c9f3-43ab-b928-c45cfbb04e0b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:34.299460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:34.373259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f38c7-c9f3-43ab-b928-c45cfbb04e0b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:34.407143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766c976-ad20-4a76-a7c4-72c56e338dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:34.407851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c976-ad20-4a76-a7c4-72c56e338dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:34.408127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c976-ad20-4a76-a7c4-72c56e338dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:34.408393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c976-ad20-4a76-a7c4-72c56e338dd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:34.419524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766c976-ad20-4a76-a7c4-72c56e338dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4766c976-ad20-4a76-a7c4-72c56e338dd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:19:34.426971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:19:34.428148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:19:34.429183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 591/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:19:34.434606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7431e68-9524-4fe1-807d-6d791dc5443a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:34.536533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7431e68-9524-4fe1-807d-6d791dc5443a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:34.565244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:34.575600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ca29c-2686-45dd-bfcb-75ac907b010b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:34.576275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca29c-2686-45dd-bfcb-75ac907b010b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:34.576560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca29c-2686-45dd-bfcb-75ac907b010b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:34.576838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca29c-2686-45dd-bfcb-75ac907b010b None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:34.577635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ca29c-2686-45dd-bfcb-75ac907b010b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:34.577944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ca29c-2686-45dd-bfcb-75ac907b010b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:34.579338 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ca29c-2686-45dd-bfcb-75ac907b010b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:34.588525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 590/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:34.594366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766c976-ad20-4a76-a7c4-72c56e338dd3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:34.693173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:34.704332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766c976-ad20-4a76-a7c4-72c56e338dd3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:34.739428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cab5bb-0df5-46d9-bdb9-3d4479141984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:34.740305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cab5bb-0df5-46d9-bdb9-3d4479141984 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:34.740587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cab5bb-0df5-46d9-bdb9-3d4479141984 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:34.740874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cab5bb-0df5-46d9-bdb9-3d4479141984 None admin] PATH_INFO: `/v3/users/65aba40cf41d4cf48493961373ff66fb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:34.756312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cab5bb-0df5-46d9-bdb9-3d4479141984 None admin] RBAC: Authorizing `identity:get_user(user_id=65aba40cf41d4cf48493961373ff66fb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:34.757817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cab5bb-0df5-46d9-bdb9-3d4479141984 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:34.759506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 592/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:34 2022] GET /identity/v3/users/65aba40cf41d4cf48493961373ff66fb => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:34.765877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ca29c-2686-45dd-bfcb-75ac907b010b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:34.874215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ca29c-2686-45dd-bfcb-75ac907b010b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:34.912420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655bf87-f599-4a25-8d28-bf46ca12f30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:34.913089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655bf87-f599-4a25-8d28-bf46ca12f30f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:34.913372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655bf87-f599-4a25-8d28-bf46ca12f30f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:34.913647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655bf87-f599-4a25-8d28-bf46ca12f30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:34.985900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:34.997473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655bf87-f599-4a25-8d28-bf46ca12f30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:34.998987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655bf87-f599-4a25-8d28-bf46ca12f30f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:35.107075 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 591/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:19:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:19:35.116804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cab5bb-0df5-46d9-bdb9-3d4479141984 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:35.226893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cab5bb-0df5-46d9-bdb9-3d4479141984 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:35.264384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f40e2-e0ef-4c55-ac32-da7ef74b4e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:35.265187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f40e2-e0ef-4c55-ac32-da7ef74b4e3a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:35.265460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f40e2-e0ef-4c55-ac32-da7ef74b4e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:35.265730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f40e2-e0ef-4c55-ac32-da7ef74b4e3a None admin] PATH_INFO: `/v3/projects/975dadf6306c4d53b1f9fbff20cf6ce8` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:35.267006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f40e2-e0ef-4c55-ac32-da7ef74b4e3a None admin] RBAC: Authorizing `identity:get_project(project_id=975dadf6306c4d53b1f9fbff20cf6ce8)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:35.268444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f40e2-e0ef-4c55-ac32-da7ef74b4e3a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:35.270154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 593/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:19:35 2022] GET /identity/v3/projects/975dadf6306c4d53b1f9fbff20cf6ce8 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:35.277439 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655bf87-f599-4a25-8d28-bf46ca12f30f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:35.400256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:35.411352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655bf87-f599-4a25-8d28-bf46ca12f30f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:35.447780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d1631-f3a7-40d7-b071-ac3edd0f4dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:35.448431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1631-f3a7-40d7-b071-ac3edd0f4dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:35.448710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1631-f3a7-40d7-b071-ac3edd0f4dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:35.449022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d1631-f3a7-40d7-b071-ac3edd0f4dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:35.449859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d1631-f3a7-40d7-b071-ac3edd0f4dc0 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=975dadf6306c4d53b1f9fbff20cf6ce8, user.id=65aba40cf41d4cf48493961373ff66fb) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:35.450178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d1631-f3a7-40d7-b071-ac3edd0f4dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:35.451626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d1631-f3a7-40d7-b071-ac3edd0f4dc0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:35.457240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 592/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:19:35 2022] GET /identity/v3/role_assignments?user.id=65aba40cf41d4cf48493961373ff66fb&scope.project.id=975dadf6306c4d53b1f9fbff20cf6ce8&role.id=842af9e8967047df873d061df391e820 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:37.462565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58297503-0c24-4c8f-8767-6a307242b260 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:37.463428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58297503-0c24-4c8f-8767-6a307242b260 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:37.463428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58297503-0c24-4c8f-8767-6a307242b260 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:37.464812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 594/1186] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:37.470400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6902c-6127-4392-b6b5-74e7d2c8ac04 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:37.470835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6902c-6127-4392-b6b5-74e7d2c8ac04 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:37.470937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6902c-6127-4392-b6b5-74e7d2c8ac04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:37.487820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-44d6902c-6127-4392-b6b5-74e7d2c8ac04 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:37.489054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-44d6902c-6127-4392-b6b5-74e7d2c8ac04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:37.560569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 593/1187] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:37.583974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58297503-0c24-4c8f-8767-6a307242b260 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:37.608876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:37.695862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58297503-0c24-4c8f-8767-6a307242b260 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:37.733411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a57b6-e13c-4cec-a3c9-cd71f1172052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:37.734130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a57b6-e13c-4cec-a3c9-cd71f1172052 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:37.734413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a57b6-e13c-4cec-a3c9-cd71f1172052 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:37.734682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a57b6-e13c-4cec-a3c9-cd71f1172052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:37.751131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a57b6-e13c-4cec-a3c9-cd71f1172052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-401a57b6-e13c-4cec-a3c9-cd71f1172052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:19:37.762480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:19:37.763575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:19:37.764620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 595/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:19:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:19:37.770043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6902c-6127-4392-b6b5-74e7d2c8ac04 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:37.857836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:37.878129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6902c-6127-4392-b6b5-74e7d2c8ac04 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:37.913645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de15c3-eddf-42a6-b528-d47059360327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:37.914306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de15c3-eddf-42a6-b528-d47059360327 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:37.914596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de15c3-eddf-42a6-b528-d47059360327 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:37.914868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de15c3-eddf-42a6-b528-d47059360327 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:37.915618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de15c3-eddf-42a6-b528-d47059360327 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:37.915910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de15c3-eddf-42a6-b528-d47059360327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:37.917388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de15c3-eddf-42a6-b528-d47059360327 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:37.925446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 594/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:19:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:37.935042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a57b6-e13c-4cec-a3c9-cd71f1172052 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:38.020638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:38.047016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a57b6-e13c-4cec-a3c9-cd71f1172052 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:38.081731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e75c0-3b9a-4488-8421-fe6ce29b1473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:38.082601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e75c0-3b9a-4488-8421-fe6ce29b1473 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:38.082877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e75c0-3b9a-4488-8421-fe6ce29b1473 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:38.083152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e75c0-3b9a-4488-8421-fe6ce29b1473 None admin] PATH_INFO: `/v3/users/65aba40cf41d4cf48493961373ff66fb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:38.084380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e75c0-3b9a-4488-8421-fe6ce29b1473 None admin] RBAC: Authorizing `identity:get_user(user_id=65aba40cf41d4cf48493961373ff66fb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:38.085858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e75c0-3b9a-4488-8421-fe6ce29b1473 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:38.087519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 596/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:37 2022] GET /identity/v3/users/65aba40cf41d4cf48493961373ff66fb => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:38.093859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de15c3-eddf-42a6-b528-d47059360327 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:38.216347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de15c3-eddf-42a6-b528-d47059360327 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:38.252593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bafbae-a568-4f11-98c4-37f5f1194112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:38.253481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bafbae-a568-4f11-98c4-37f5f1194112 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:38.253758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bafbae-a568-4f11-98c4-37f5f1194112 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:38.254029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bafbae-a568-4f11-98c4-37f5f1194112 None admin] PATH_INFO: `/v3/projects/975dadf6306c4d53b1f9fbff20cf6ce8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:38.255255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bafbae-a568-4f11-98c4-37f5f1194112 None admin] RBAC: Authorizing `identity:get_project(project_id=975dadf6306c4d53b1f9fbff20cf6ce8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:38.256717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bafbae-a568-4f11-98c4-37f5f1194112 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:38.258457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 595/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:19:38 2022] GET /identity/v3/projects/975dadf6306c4d53b1f9fbff20cf6ce8 => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:38.264749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e75c0-3b9a-4488-8421-fe6ce29b1473 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:38.364049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e75c0-3b9a-4488-8421-fe6ce29b1473 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:38.399895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b01ef-7331-4731-81fb-2e5c20c2abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:38.400824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b01ef-7331-4731-81fb-2e5c20c2abbb None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:38.401135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b01ef-7331-4731-81fb-2e5c20c2abbb None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:38.401403 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b01ef-7331-4731-81fb-2e5c20c2abbb None admin] PATH_INFO: `/v3/projects/975dadf6306c4d53b1f9fbff20cf6ce8/users/65aba40cf41d4cf48493961373ff66fb/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:38.403456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b01ef-7331-4731-81fb-2e5c20c2abbb None admin] RBAC: Authorizing `identity:create_grant(project_id=975dadf6306c4d53b1f9fbff20cf6ce8, user_id=65aba40cf41d4cf48493961373ff66fb, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:38.404931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b01ef-7331-4731-81fb-2e5c20c2abbb None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:38.421003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 597/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:19:38 2022] PUT /identity/v3/projects/975dadf6306c4d53b1f9fbff20cf6ce8/users/65aba40cf41d4cf48493961373ff66fb/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:19:40.423366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c633860-a833-44fd-84dd-cfb6deca09d5 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:40.423976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c633860-a833-44fd-84dd-cfb6deca09d5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:40.423976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c633860-a833-44fd-84dd-cfb6deca09d5 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:40.425661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 596/1193] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:19:40.430829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8687a92-2269-466c-965c-713310be505a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:40.431270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8687a92-2269-466c-965c-713310be505a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:40.431357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8687a92-2269-466c-965c-713310be505a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:40.443539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:40.449184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a8687a92-2269-466c-965c-713310be505a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:19:40.450952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a8687a92-2269-466c-965c-713310be505a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:19:40.519385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 598/1194] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:19:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:19:40.543229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c633860-a833-44fd-84dd-cfb6deca09d5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:40.560207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:40.646814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c633860-a833-44fd-84dd-cfb6deca09d5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:40.681990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd675bf-ec28-48a2-a314-ff33573d76aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:40.682715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd675bf-ec28-48a2-a314-ff33573d76aa None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:40.683002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd675bf-ec28-48a2-a314-ff33573d76aa None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:40.683280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd675bf-ec28-48a2-a314-ff33573d76aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:40.694726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd675bf-ec28-48a2-a314-ff33573d76aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-6bd675bf-ec28-48a2-a314-ff33573d76aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:19:40.702384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:19:40.703464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:19:40.704496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 597/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:19:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:19:40.712531 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8687a92-2269-466c-965c-713310be505a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:40.823791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8687a92-2269-466c-965c-713310be505a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:40.861686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717aa83-cf2e-4e4a-9e85-8fcb0ff83f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:40.862342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717aa83-cf2e-4e4a-9e85-8fcb0ff83f52 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:40.862617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717aa83-cf2e-4e4a-9e85-8fcb0ff83f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:40.862889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717aa83-cf2e-4e4a-9e85-8fcb0ff83f52 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:40.863633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717aa83-cf2e-4e4a-9e85-8fcb0ff83f52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:40.863930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717aa83-cf2e-4e4a-9e85-8fcb0ff83f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:40.865353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717aa83-cf2e-4e4a-9e85-8fcb0ff83f52 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:40.867798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:40.875213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 599/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:19:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:40.884941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd675bf-ec28-48a2-a314-ff33573d76aa None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:40.963831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:40.990769 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd675bf-ec28-48a2-a314-ff33573d76aa None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:41.026277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4fa73-b041-40fd-b8b9-b553bcc348d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:41.027144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4fa73-b041-40fd-b8b9-b553bcc348d5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:41.027422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4fa73-b041-40fd-b8b9-b553bcc348d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:41.027696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4fa73-b041-40fd-b8b9-b553bcc348d5 None admin] PATH_INFO: `/v3/users/65aba40cf41d4cf48493961373ff66fb` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:41.029017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4fa73-b041-40fd-b8b9-b553bcc348d5 None admin] RBAC: Authorizing `identity:get_user(user_id=65aba40cf41d4cf48493961373ff66fb)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:41.030410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4fa73-b041-40fd-b8b9-b553bcc348d5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:41.032021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 598/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Fri Jul 1 16:19:40 2022] GET /identity/v3/users/65aba40cf41d4cf48493961373ff66fb => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:41.038136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717aa83-cf2e-4e4a-9e85-8fcb0ff83f52 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:41.143872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717aa83-cf2e-4e4a-9e85-8fcb0ff83f52 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:41.178535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10951-1675-485e-9afd-db878f50d5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:41.179174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10951-1675-485e-9afd-db878f50d5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:41.179453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10951-1675-485e-9afd-db878f50d5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:41.179727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a10951-1675-485e-9afd-db878f50d5c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:41.248504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:41.252072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a10951-1675-485e-9afd-db878f50d5c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:41.253634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a10951-1675-485e-9afd-db878f50d5c3 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:41.358483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 600/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:19:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:19:41.368168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4fa73-b041-40fd-b8b9-b553bcc348d5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:41.505495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4fa73-b041-40fd-b8b9-b553bcc348d5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:41.541901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd844b4a-8663-4e48-9a75-bf8e2c42b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:41.542756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844b4a-8663-4e48-9a75-bf8e2c42b6ed None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:41.543036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844b4a-8663-4e48-9a75-bf8e2c42b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:41.543309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd844b4a-8663-4e48-9a75-bf8e2c42b6ed None admin] PATH_INFO: `/v3/projects/975dadf6306c4d53b1f9fbff20cf6ce8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:41.544618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd844b4a-8663-4e48-9a75-bf8e2c42b6ed None admin] RBAC: Authorizing `identity:get_project(project_id=975dadf6306c4d53b1f9fbff20cf6ce8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:41.546109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd844b4a-8663-4e48-9a75-bf8e2c42b6ed None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:41.547807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 599/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Fri Jul 1 16:19:41 2022] GET /identity/v3/projects/975dadf6306c4d53b1f9fbff20cf6ce8 => generated 361 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:41.554401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10951-1675-485e-9afd-db878f50d5c3 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:19:41.657180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:41.661452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a10951-1675-485e-9afd-db878f50d5c3 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:19:41.696022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b8ad84-dc8b-4c2e-b5c3-1a7cafca6323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:19:41.696665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ad84-dc8b-4c2e-b5c3-1a7cafca6323 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:19:41.696978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ad84-dc8b-4c2e-b5c3-1a7cafca6323 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:19:41.697296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b8ad84-dc8b-4c2e-b5c3-1a7cafca6323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:19:41.698136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8ad84-dc8b-4c2e-b5c3-1a7cafca6323 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=975dadf6306c4d53b1f9fbff20cf6ce8, user.id=65aba40cf41d4cf48493961373ff66fb) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:19:41.698448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8ad84-dc8b-4c2e-b5c3-1a7cafca6323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:19:41.699887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b8ad84-dc8b-4c2e-b5c3-1a7cafca6323 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:19:41.705883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 601/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:19:41 2022] GET /identity/v3/role_assignments?user.id=65aba40cf41d4cf48493961373ff66fb&scope.project.id=975dadf6306c4d53b1f9fbff20cf6ce8&role.id=842af9e8967047df873d061df391e820 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:19:51.537066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:19:51.703113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=19 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:36.722500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa893-bb1a-4c84-985d-373f23d31445 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:36.723130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa893-bb1a-4c84-985d-373f23d31445 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:36.723130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fa893-bb1a-4c84-985d-373f23d31445 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:36.724955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 600/1201] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:20:36.730559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349b2f-7670-49e1-83b5-f9d9fe5a4062 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:36.731276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349b2f-7670-49e1-83b5-f9d9fe5a4062 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:36.731276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349b2f-7670-49e1-83b5-f9d9fe5a4062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:36.754606 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d2349b2f-7670-49e1-83b5-f9d9fe5a4062 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:20:36.755804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d2349b2f-7670-49e1-83b5-f9d9fe5a4062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:20:36.834201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 602/1202] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:20:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:20:36.861091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fa893-bb1a-4c84-985d-373f23d31445 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:37.001993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fa893-bb1a-4c84-985d-373f23d31445 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:37.043194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030549f8-b8a6-4d58-94e1-cb7e6d19d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:37.044015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030549f8-b8a6-4d58-94e1-cb7e6d19d818 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:37.044296 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030549f8-b8a6-4d58-94e1-cb7e6d19d818 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:37.044621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030549f8-b8a6-4d58-94e1-cb7e6d19d818 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:37.058561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030549f8-b8a6-4d58-94e1-cb7e6d19d818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:37.060184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030549f8-b8a6-4d58-94e1-cb7e6d19d818 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-030549f8-b8a6-4d58-94e1-cb7e6d19d818 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:37.081343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:37.082549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:37.086149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:37.086149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:37.086149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:37.086149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:37.086149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 601/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:20:37.089217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2349b2f-7670-49e1-83b5-f9d9fe5a4062 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:37.208664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2349b2f-7670-49e1-83b5-f9d9fe5a4062 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:37.249014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:37.255275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8c582-04b7-4fd1-a982-7d7a4c0b322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:37.256235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c582-04b7-4fd1-a982-7d7a4c0b322a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:37.256800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c582-04b7-4fd1-a982-7d7a4c0b322a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:37.257481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8c582-04b7-4fd1-a982-7d7a4c0b322a None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:37.258224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8c582-04b7-4fd1-a982-7d7a4c0b322a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:37.258527 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8c582-04b7-4fd1-a982-7d7a4c0b322a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:37.259923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8c582-04b7-4fd1-a982-7d7a4c0b322a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:37.275509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 603/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:20:37.282379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030549f8-b8a6-4d58-94e1-cb7e6d19d818 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:37.347446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:37.424328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030549f8-b8a6-4d58-94e1-cb7e6d19d818 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:37.469388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097a6d9-2978-4ae6-9a9a-e5c3ed0a3259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:37.470094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097a6d9-2978-4ae6-9a9a-e5c3ed0a3259 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:37.470366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097a6d9-2978-4ae6-9a9a-e5c3ed0a3259 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:37.470755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097a6d9-2978-4ae6-9a9a-e5c3ed0a3259 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:37.471663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097a6d9-2978-4ae6-9a9a-e5c3ed0a3259 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:37.473388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097a6d9-2978-4ae6-9a9a-e5c3ed0a3259 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:37.506818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 602/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Fri Jul 1 16:20:37 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:20:39.705889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6a801-67b2-43a0-a92e-ed1a5c7c4b24 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:39.706475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6a801-67b2-43a0-a92e-ed1a5c7c4b24 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:39.706475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6a801-67b2-43a0-a92e-ed1a5c7c4b24 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:39.707835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 604/1206] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:20:39.714584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4588a22-3efa-44cf-8ee7-1a5ef14330e4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:39.715444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4588a22-3efa-44cf-8ee7-1a5ef14330e4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:39.715444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4588a22-3efa-44cf-8ee7-1a5ef14330e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:39.733895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a4588a22-3efa-44cf-8ee7-1a5ef14330e4 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:20:39.735210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a4588a22-3efa-44cf-8ee7-1a5ef14330e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:20:39.823920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 603/1207] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:20:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:20:39.850912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6a801-67b2-43a0-a92e-ed1a5c7c4b24 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:39.968110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6a801-67b2-43a0-a92e-ed1a5c7c4b24 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:40.011715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e733c32-f4c3-40c9-9799-575f5d9aa3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:40.012515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e733c32-f4c3-40c9-9799-575f5d9aa3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:40.012798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e733c32-f4c3-40c9-9799-575f5d9aa3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:40.013113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e733c32-f4c3-40c9-9799-575f5d9aa3f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:40.024509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e733c32-f4c3-40c9-9799-575f5d9aa3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4e733c32-f4c3-40c9-9799-575f5d9aa3f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:20:40.032230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:40.036923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:40.038087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 605/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:20:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:20:40.040066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4588a22-3efa-44cf-8ee7-1a5ef14330e4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:40.091041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:40.163640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4588a22-3efa-44cf-8ee7-1a5ef14330e4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:40.203853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20435-28f5-461f-bbe3-3d346a62439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:40.204536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20435-28f5-461f-bbe3-3d346a62439c None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:40.204819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20435-28f5-461f-bbe3-3d346a62439c None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:40.205160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e20435-28f5-461f-bbe3-3d346a62439c None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:40.205914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e20435-28f5-461f-bbe3-3d346a62439c None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:40.206221 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e20435-28f5-461f-bbe3-3d346a62439c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:40.207607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e20435-28f5-461f-bbe3-3d346a62439c None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:40.216623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 604/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:20:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:40.222949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e733c32-f4c3-40c9-9799-575f5d9aa3f5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:40.279211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:40.335183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e733c32-f4c3-40c9-9799-575f5d9aa3f5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:40.372124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c78082-4b8d-419b-807a-6d35d6c1f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:40.373133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c78082-4b8d-419b-807a-6d35d6c1f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:40.373414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c78082-4b8d-419b-807a-6d35d6c1f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:40.373723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c78082-4b8d-419b-807a-6d35d6c1f9e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:40.385990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c78082-4b8d-419b-807a-6d35d6c1f9e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:40.387616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c78082-4b8d-419b-807a-6d35d6c1f9e1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-94c78082-4b8d-419b-807a-6d35d6c1f9e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:40.405727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:40.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:40.415285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:40.415285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:40.415285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:40.415285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:40.415285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 606/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:40.415652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20435-28f5-461f-bbe3-3d346a62439c None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:40.523130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:40.526600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e20435-28f5-461f-bbe3-3d346a62439c None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:40.564956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a740e-af37-4103-a287-918f1f4fb62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:40.565630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a740e-af37-4103-a287-918f1f4fb62b None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:40.565916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a740e-af37-4103-a287-918f1f4fb62b None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:40.567034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a740e-af37-4103-a287-918f1f4fb62b None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:40.567034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a740e-af37-4103-a287-918f1f4fb62b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:40.567283 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a740e-af37-4103-a287-918f1f4fb62b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:40.568863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a740e-af37-4103-a287-918f1f4fb62b None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:40.582674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 605/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:40.588971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c78082-4b8d-419b-807a-6d35d6c1f9e1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:40.717093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c78082-4b8d-419b-807a-6d35d6c1f9e1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:40.719262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:40.770239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0628c38-2016-46c1-a5ae-044c680f152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:40.771093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0628c38-2016-46c1-a5ae-044c680f152d None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:40.771374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0628c38-2016-46c1-a5ae-044c680f152d None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:40.771651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0628c38-2016-46c1-a5ae-044c680f152d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:40.782442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0628c38-2016-46c1-a5ae-044c680f152d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:40.783950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0628c38-2016-46c1-a5ae-044c680f152d None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e0628c38-2016-46c1-a5ae-044c680f152d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:20:40.800728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:40.804012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:40.805033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 607/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:40.808393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a740e-af37-4103-a287-918f1f4fb62b None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:40.936245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a740e-af37-4103-a287-918f1f4fb62b None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:40.982136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99296852-5913-41ae-83fa-ec19a0254868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:40.983028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99296852-5913-41ae-83fa-ec19a0254868 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:40.983407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99296852-5913-41ae-83fa-ec19a0254868 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:40.983796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99296852-5913-41ae-83fa-ec19a0254868 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:40.984777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99296852-5913-41ae-83fa-ec19a0254868 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:40.985354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99296852-5913-41ae-83fa-ec19a0254868 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:40.986898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99296852-5913-41ae-83fa-ec19a0254868 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:41.007112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 606/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Fri Jul 1 16:20:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:41.012882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0628c38-2016-46c1-a5ae-044c680f152d None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:41.131261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0628c38-2016-46c1-a5ae-044c680f152d None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:41.168856 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b4529-61f8-4cf4-bdbc-aa14235a04ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:41.169632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b4529-61f8-4cf4-bdbc-aa14235a04ed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:41.169913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b4529-61f8-4cf4-bdbc-aa14235a04ed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:41.170189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b4529-61f8-4cf4-bdbc-aa14235a04ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:41.202844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:41.252143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b4529-61f8-4cf4-bdbc-aa14235a04ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:41.253801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b4529-61f8-4cf4-bdbc-aa14235a04ed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:41.380077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 608/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:20:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:20:41.386610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99296852-5913-41ae-83fa-ec19a0254868 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:41.408867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:41.503756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99296852-5913-41ae-83fa-ec19a0254868 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:41.543815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d498fd2-1e62-4047-88ce-e4d773caf0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:41.544726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d498fd2-1e62-4047-88ce-e4d773caf0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:41.545097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d498fd2-1e62-4047-88ce-e4d773caf0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:41.545443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d498fd2-1e62-4047-88ce-e4d773caf0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:41.557564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d498fd2-1e62-4047-88ce-e4d773caf0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:41.559325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d498fd2-1e62-4047-88ce-e4d773caf0c0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-4d498fd2-1e62-4047-88ce-e4d773caf0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:41.579472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:41.580913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:41.581818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:41.581818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:41.581818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:41.581818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:41.581818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 607/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:20:41.586778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b4529-61f8-4cf4-bdbc-aa14235a04ed None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:41.658829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:41.702886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b4529-61f8-4cf4-bdbc-aa14235a04ed None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:41.746144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf92e2-780a-44ea-98d4-8d00b4e772dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:41.747131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf92e2-780a-44ea-98d4-8d00b4e772dd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:41.747131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf92e2-780a-44ea-98d4-8d00b4e772dd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:41.747539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf92e2-780a-44ea-98d4-8d00b4e772dd None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:41.748214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf92e2-780a-44ea-98d4-8d00b4e772dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:41.748523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf92e2-780a-44ea-98d4-8d00b4e772dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:41.749987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf92e2-780a-44ea-98d4-8d00b4e772dd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:41.765739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 609/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:20:41.771858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d498fd2-1e62-4047-88ce-e4d773caf0c0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:41.848519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:41.883960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d498fd2-1e62-4047-88ce-e4d773caf0c0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:41.923683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb043cb-8544-4f05-adab-ac253aa9f7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:41.924447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb043cb-8544-4f05-adab-ac253aa9f7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:41.924757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb043cb-8544-4f05-adab-ac253aa9f7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:41.925144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb043cb-8544-4f05-adab-ac253aa9f7e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:41.933617 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb043cb-8544-4f05-adab-ac253aa9f7e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:41.935161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb043cb-8544-4f05-adab-ac253aa9f7e1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-dbb043cb-8544-4f05-adab-ac253aa9f7e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:20:41.951149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:41.952392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:41.954582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:20:41.954582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:20:41.954582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:20:41.954582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:20:41.954582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:20:41.954582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:20:41.954582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:41.954582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:41.954582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 608/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:41.959339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf92e2-780a-44ea-98d4-8d00b4e772dd None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:42.079498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf92e2-780a-44ea-98d4-8d00b4e772dd None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:42.106062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:42.122744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab5bcf-634b-45b1-beef-66aea76f941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:42.123652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5bcf-634b-45b1-beef-66aea76f941a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:42.123971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5bcf-634b-45b1-beef-66aea76f941a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:42.124290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5bcf-634b-45b1-beef-66aea76f941a None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:42.125294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab5bcf-634b-45b1-beef-66aea76f941a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:42.125609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab5bcf-634b-45b1-beef-66aea76f941a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:42.127232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab5bcf-634b-45b1-beef-66aea76f941a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:42.140979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 610/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:42.147763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb043cb-8544-4f05-adab-ac253aa9f7e1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:42.260955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb043cb-8544-4f05-adab-ac253aa9f7e1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:42.297559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:42.305239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e6763-91c5-4864-916f-c34779c31301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:42.305986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e6763-91c5-4864-916f-c34779c31301 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:42.306370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e6763-91c5-4864-916f-c34779c31301 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:42.306709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e6763-91c5-4864-916f-c34779c31301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:42.307608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e6763-91c5-4864-916f-c34779c31301 None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=eb3ded7163fa400399d1b09079a366ed) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:42.308054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e6763-91c5-4864-916f-c34779c31301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:42.309676 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e6763-91c5-4864-916f-c34779c31301 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:42.324886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 609/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:20:42 2022] GET /identity/v3/role_assignments?user.id=eb3ded7163fa400399d1b09079a366ed&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:44.478879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da65b3-e0a2-47cb-83b7-1cfadfb7f95d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:44.479482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da65b3-e0a2-47cb-83b7-1cfadfb7f95d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:44.479482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da65b3-e0a2-47cb-83b7-1cfadfb7f95d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:44.481086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 611/1220] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:20:44.486814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693055a-5318-414c-9f50-ba5dfa81327f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:44.487239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693055a-5318-414c-9f50-ba5dfa81327f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:44.487448 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693055a-5318-414c-9f50-ba5dfa81327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:44.506941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a693055a-5318-414c-9f50-ba5dfa81327f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:20:44.508217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a693055a-5318-414c-9f50-ba5dfa81327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:20:44.586556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 610/1221] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:20:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:20:44.611406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da65b3-e0a2-47cb-83b7-1cfadfb7f95d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:44.730157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da65b3-e0a2-47cb-83b7-1cfadfb7f95d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:44.769512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afb82c-853b-46e8-aee3-333b06fb9619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:44.770390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afb82c-853b-46e8-aee3-333b06fb9619 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:44.770673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afb82c-853b-46e8-aee3-333b06fb9619 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:44.770954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afb82c-853b-46e8-aee3-333b06fb9619 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:44.782168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afb82c-853b-46e8-aee3-333b06fb9619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-e4afb82c-853b-46e8-aee3-333b06fb9619 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:20:44.789910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:44.791018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:44.792099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 612/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:20:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:44.797801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693055a-5318-414c-9f50-ba5dfa81327f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:44.902987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693055a-5318-414c-9f50-ba5dfa81327f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:44.931536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:44.943855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eef70b-97fc-447e-8b4a-0a0940c93e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:44.944589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eef70b-97fc-447e-8b4a-0a0940c93e34 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:44.944891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eef70b-97fc-447e-8b4a-0a0940c93e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:44.945173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eef70b-97fc-447e-8b4a-0a0940c93e34 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:44.945929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eef70b-97fc-447e-8b4a-0a0940c93e34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:44.946241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eef70b-97fc-447e-8b4a-0a0940c93e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:44.947632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eef70b-97fc-447e-8b4a-0a0940c93e34 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:44.956821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 611/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:20:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:44.963510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afb82c-853b-46e8-aee3-333b06fb9619 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:45.015189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:45.079071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afb82c-853b-46e8-aee3-333b06fb9619 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:45.117540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df23af-e7de-49c8-b668-7b717934cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:45.118366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df23af-e7de-49c8-b668-7b717934cf85 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:45.118692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df23af-e7de-49c8-b668-7b717934cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:45.118972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df23af-e7de-49c8-b668-7b717934cf85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:45.130146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df23af-e7de-49c8-b668-7b717934cf85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:45.131710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df23af-e7de-49c8-b668-7b717934cf85 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-66df23af-e7de-49c8-b668-7b717934cf85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:45.149589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:45.150591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:45.151631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:45.151631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:45.151631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:45.151631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:45.151631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 613/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:45.157448 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eef70b-97fc-447e-8b4a-0a0940c93e34 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:45.267089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eef70b-97fc-447e-8b4a-0a0940c93e34 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:45.302664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb4eb2-2d79-4f9e-aba0-bbea8343ea68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:45.303514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb4eb2-2d79-4f9e-aba0-bbea8343ea68 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:45.303792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb4eb2-2d79-4f9e-aba0-bbea8343ea68 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:45.304061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb4eb2-2d79-4f9e-aba0-bbea8343ea68 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:45.304773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb4eb2-2d79-4f9e-aba0-bbea8343ea68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:45.305106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb4eb2-2d79-4f9e-aba0-bbea8343ea68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:45.306486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cb4eb2-2d79-4f9e-aba0-bbea8343ea68 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:45.318387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 612/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:45.324885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df23af-e7de-49c8-b668-7b717934cf85 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:45.424382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:45.431444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df23af-e7de-49c8-b668-7b717934cf85 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:45.467344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b188a-f70b-4a79-87ba-e5a90cc7744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:45.468184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b188a-f70b-4a79-87ba-e5a90cc7744e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:45.468460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b188a-f70b-4a79-87ba-e5a90cc7744e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:45.468718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b188a-f70b-4a79-87ba-e5a90cc7744e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:45.477171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b188a-f70b-4a79-87ba-e5a90cc7744e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:45.478683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b188a-f70b-4a79-87ba-e5a90cc7744e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-664b188a-f70b-4a79-87ba-e5a90cc7744e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:20:45.493100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:45.494666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:45.495655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 614/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:45.500463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb4eb2-2d79-4f9e-aba0-bbea8343ea68 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:45.553411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:45.615252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb4eb2-2d79-4f9e-aba0-bbea8343ea68 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:45.652373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccf723-9fcf-4175-a2d5-70f292302e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:45.653505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf723-9fcf-4175-a2d5-70f292302e59 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:45.654010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf723-9fcf-4175-a2d5-70f292302e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:45.654368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccf723-9fcf-4175-a2d5-70f292302e59 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:45.655557 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccf723-9fcf-4175-a2d5-70f292302e59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:45.655993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccf723-9fcf-4175-a2d5-70f292302e59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:45.657922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccf723-9fcf-4175-a2d5-70f292302e59 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:45.679101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 613/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Fri Jul 1 16:20:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:45.686185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b188a-f70b-4a79-87ba-e5a90cc7744e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:45.807667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b188a-f70b-4a79-87ba-e5a90cc7744e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:45.849031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6abb95-a1df-4b63-b8ce-cfd8f5780603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:45.849846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6abb95-a1df-4b63-b8ce-cfd8f5780603 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:45.850145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6abb95-a1df-4b63-b8ce-cfd8f5780603 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:45.850444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6abb95-a1df-4b63-b8ce-cfd8f5780603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:45.861465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6abb95-a1df-4b63-b8ce-cfd8f5780603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:45.862996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6abb95-a1df-4b63-b8ce-cfd8f5780603 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-9f6abb95-a1df-4b63-b8ce-cfd8f5780603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:45.882350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:45.883355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:45.884367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:45.884367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:45.884367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:45.884367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:45.884367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 615/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:45.890351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccf723-9fcf-4175-a2d5-70f292302e59 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:45.994829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccf723-9fcf-4175-a2d5-70f292302e59 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:45.997509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:46.033996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5a4b9-9f2c-46da-9b42-bd00014ac27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:46.034854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5a4b9-9f2c-46da-9b42-bd00014ac27e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:46.035137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5a4b9-9f2c-46da-9b42-bd00014ac27e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:46.035408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5a4b9-9f2c-46da-9b42-bd00014ac27e None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:46.036356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5a4b9-9f2c-46da-9b42-bd00014ac27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:46.036875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5a4b9-9f2c-46da-9b42-bd00014ac27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:46.038492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c5a4b9-9f2c-46da-9b42-bd00014ac27e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:46.052124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 614/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:20:46.059029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6abb95-a1df-4b63-b8ce-cfd8f5780603 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:46.069258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:46.174786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6abb95-a1df-4b63-b8ce-cfd8f5780603 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:46.208622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2d2c-954a-4da6-a357-6033edcf8289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:46.209445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2d2c-954a-4da6-a357-6033edcf8289 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:46.209728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2d2c-954a-4da6-a357-6033edcf8289 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:46.210006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba2d2c-954a-4da6-a357-6033edcf8289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:46.216756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2d2c-954a-4da6-a357-6033edcf8289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:46.218249 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba2d2c-954a-4da6-a357-6033edcf8289 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4fba2d2c-954a-4da6-a357-6033edcf8289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:20:46.232912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:46.233990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:46.234953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:20:46.234953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:20:46.234953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:20:46.234953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:20:46.234953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:20:46.234953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:20:46.234953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:46.234953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:46.234953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 616/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:46.240326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5a4b9-9f2c-46da-9b42-bd00014ac27e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:46.350865 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5a4b9-9f2c-46da-9b42-bd00014ac27e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:46.394107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb91f5-d626-4167-ada8-edfb68c81ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:46.394858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb91f5-d626-4167-ada8-edfb68c81ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:46.395135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb91f5-d626-4167-ada8-edfb68c81ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:46.395456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb91f5-d626-4167-ada8-edfb68c81ea2 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:46.396358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb91f5-d626-4167-ada8-edfb68c81ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:46.396740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb91f5-d626-4167-ada8-edfb68c81ea2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:46.398259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb91f5-d626-4167-ada8-edfb68c81ea2 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:46.410873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 615/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:46.417301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2d2c-954a-4da6-a357-6033edcf8289 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:46.486787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:46.528860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba2d2c-954a-4da6-a357-6033edcf8289 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:46.566819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5781320-4bbb-4f53-a4f7-11f919fb85d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:46.567720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781320-4bbb-4f53-a4f7-11f919fb85d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:46.567996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781320-4bbb-4f53-a4f7-11f919fb85d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:46.568275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5781320-4bbb-4f53-a4f7-11f919fb85d7 None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/eb3ded7163fa400399d1b09079a366ed/roles/9802e06a85874fc98135684e38cb3a41` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:46.585497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5781320-4bbb-4f53-a4f7-11f919fb85d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=eb3ded7163fa400399d1b09079a366ed, role_id=9802e06a85874fc98135684e38cb3a41)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:46.587004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5781320-4bbb-4f53-a4f7-11f919fb85d7 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:46.601643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 617/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:20:46 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/eb3ded7163fa400399d1b09079a366ed/roles/9802e06a85874fc98135684e38cb3a41 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:20:48.687927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390abc0-b33c-4439-8233-d27d9ee53148 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:48.688555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390abc0-b33c-4439-8233-d27d9ee53148 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:48.688555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390abc0-b33c-4439-8233-d27d9ee53148 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:48.689887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 616/1233] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:20:48.695896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d261-0920-4c8a-9878-798dcb9d236e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:48.696323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d261-0920-4c8a-9878-798dcb9d236e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:48.696508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407d261-0920-4c8a-9878-798dcb9d236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:48.714786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9407d261-0920-4c8a-9878-798dcb9d236e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:20:48.715966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9407d261-0920-4c8a-9878-798dcb9d236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:20:48.788144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 618/1234] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:20:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:20:48.811711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390abc0-b33c-4439-8233-d27d9ee53148 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:48.844915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:48.938613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390abc0-b33c-4439-8233-d27d9ee53148 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:48.975595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cfb59-8696-43b7-9334-02210eb6684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:48.976406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cfb59-8696-43b7-9334-02210eb6684f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:48.976692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cfb59-8696-43b7-9334-02210eb6684f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:48.977056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cfb59-8696-43b7-9334-02210eb6684f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:48.988701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cfb59-8696-43b7-9334-02210eb6684f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-a26cfb59-8696-43b7-9334-02210eb6684f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:20:48.997081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:48.999016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:49.000222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 617/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Fri Jul 1 16:20:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:49.004925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d261-0920-4c8a-9878-798dcb9d236e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:49.055317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:49.114077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407d261-0920-4c8a-9878-798dcb9d236e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:49.151450 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791c48-0c43-4780-83de-d733782aa871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:49.152366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791c48-0c43-4780-83de-d733782aa871 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:49.152521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791c48-0c43-4780-83de-d733782aa871 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:49.153234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01791c48-0c43-4780-83de-d733782aa871 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:49.153546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01791c48-0c43-4780-83de-d733782aa871 None admin] RBAC: Adding query filter params (name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:49.153903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01791c48-0c43-4780-83de-d733782aa871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:49.155434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01791c48-0c43-4780-83de-d733782aa871 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:49.164902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 619/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Fri Jul 1 16:20:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:49.170689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cfb59-8696-43b7-9334-02210eb6684f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:49.263895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:49.282880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cfb59-8696-43b7-9334-02210eb6684f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:49.316954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c40fe2-b6db-4c0b-97a7-6550ef938d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:49.317751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c40fe2-b6db-4c0b-97a7-6550ef938d80 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:49.318028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c40fe2-b6db-4c0b-97a7-6550ef938d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:49.318292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c40fe2-b6db-4c0b-97a7-6550ef938d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:49.329076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c40fe2-b6db-4c0b-97a7-6550ef938d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:49.330591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c40fe2-b6db-4c0b-97a7-6550ef938d80 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-b2c40fe2-b6db-4c0b-97a7-6550ef938d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:49.347396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:49.349108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:49.350122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:49.350122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:49.350122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:49.350122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:49.350122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 618/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:49.355587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791c48-0c43-4780-83de-d733782aa871 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:49.460550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01791c48-0c43-4780-83de-d733782aa871 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:49.471710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:49.498657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843fa06-14a2-41b7-8a4d-00566059e92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:49.499490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843fa06-14a2-41b7-8a4d-00566059e92f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:49.499756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843fa06-14a2-41b7-8a4d-00566059e92f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:49.500133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843fa06-14a2-41b7-8a4d-00566059e92f None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:49.501202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843fa06-14a2-41b7-8a4d-00566059e92f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:49.501766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843fa06-14a2-41b7-8a4d-00566059e92f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:49.503598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843fa06-14a2-41b7-8a4d-00566059e92f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:49.520420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 620/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:49.527893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c40fe2-b6db-4c0b-97a7-6550ef938d80 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:49.647779 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c40fe2-b6db-4c0b-97a7-6550ef938d80 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:49.685066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758990b5-c10d-4d78-ae38-84bd002edb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:49.686209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758990b5-c10d-4d78-ae38-84bd002edb4f None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:49.686490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758990b5-c10d-4d78-ae38-84bd002edb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:49.686757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758990b5-c10d-4d78-ae38-84bd002edb4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:49.689425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:49.694817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758990b5-c10d-4d78-ae38-84bd002edb4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:49.696427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758990b5-c10d-4d78-ae38-84bd002edb4f None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-758990b5-c10d-4d78-ae38-84bd002edb4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:20:49.710678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:49.712056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:49.713693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 619/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:49.717898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843fa06-14a2-41b7-8a4d-00566059e92f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:49.829887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843fa06-14a2-41b7-8a4d-00566059e92f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:49.866658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76727f19-4159-4244-b88d-15219a8fa3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:49.867412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76727f19-4159-4244-b88d-15219a8fa3de None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:49.867767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76727f19-4159-4244-b88d-15219a8fa3de None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:49.868140 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76727f19-4159-4244-b88d-15219a8fa3de None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:49.869147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76727f19-4159-4244-b88d-15219a8fa3de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:49.869508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76727f19-4159-4244-b88d-15219a8fa3de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:49.871254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76727f19-4159-4244-b88d-15219a8fa3de None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:49.892468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 621/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Fri Jul 1 16:20:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:49.899432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758990b5-c10d-4d78-ae38-84bd002edb4f None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:50.012739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758990b5-c10d-4d78-ae38-84bd002edb4f None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:50.047629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8d56d-d0ef-41bf-9879-3b3955ed77c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:50.048333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8d56d-d0ef-41bf-9879-3b3955ed77c1 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:50.048695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8d56d-d0ef-41bf-9879-3b3955ed77c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:50.049171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8d56d-d0ef-41bf-9879-3b3955ed77c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:50.122170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:50.129780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8d56d-d0ef-41bf-9879-3b3955ed77c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:50.131352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8d56d-d0ef-41bf-9879-3b3955ed77c1 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:50.244442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 620/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:20:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:20:50.250892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76727f19-4159-4244-b88d-15219a8fa3de None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:50.279205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:50.357529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76727f19-4159-4244-b88d-15219a8fa3de None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:50.394767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13e28a-17be-487e-931f-e7b1e2bb1f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:50.395579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13e28a-17be-487e-931f-e7b1e2bb1f1f None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:50.395888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13e28a-17be-487e-931f-e7b1e2bb1f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:50.396224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13e28a-17be-487e-931f-e7b1e2bb1f1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:50.406749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13e28a-17be-487e-931f-e7b1e2bb1f1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:50.408392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13e28a-17be-487e-931f-e7b1e2bb1f1f None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-5d13e28a-17be-487e-931f-e7b1e2bb1f1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:50.428709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:50.429838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:50.430904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:50.430904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:50.430904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:50.430904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:50.430904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 622/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:20:50.436268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8d56d-d0ef-41bf-9879-3b3955ed77c1 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:50.541778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:50.548552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8d56d-d0ef-41bf-9879-3b3955ed77c1 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:50.587427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9fd3e-755c-425b-94f1-2b314f759dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:50.588298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9fd3e-755c-425b-94f1-2b314f759dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:50.588585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9fd3e-755c-425b-94f1-2b314f759dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:50.588969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9fd3e-755c-425b-94f1-2b314f759dc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:50.589897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9fd3e-755c-425b-94f1-2b314f759dc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:50.590189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9fd3e-755c-425b-94f1-2b314f759dc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:50.591821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9fd3e-755c-425b-94f1-2b314f759dc6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:50.604767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 621/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:50.610833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13e28a-17be-487e-931f-e7b1e2bb1f1f None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:50.695312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:50.721325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13e28a-17be-487e-931f-e7b1e2bb1f1f None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:50.761752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5565d15-1903-4fc0-b2c6-49ac06c0493e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:50.762553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5565d15-1903-4fc0-b2c6-49ac06c0493e None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:50.762828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5565d15-1903-4fc0-b2c6-49ac06c0493e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:50.763095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5565d15-1903-4fc0-b2c6-49ac06c0493e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:50.770785 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5565d15-1903-4fc0-b2c6-49ac06c0493e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:50.772248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5565d15-1903-4fc0-b2c6-49ac06c0493e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-c5565d15-1903-4fc0-b2c6-49ac06c0493e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:20:50.786379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:50.787502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:50.788394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:20:50.788394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:20:50.788394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:20:50.788394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:20:50.788394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:20:50.788394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:20:50.788394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:50.788394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:50.788394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 623/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:20:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:50.793873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9fd3e-755c-425b-94f1-2b314f759dc6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:50.904942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9fd3e-755c-425b-94f1-2b314f759dc6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:50.940912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2222ae6-5e19-4aaa-82df-fe253be320d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:50.941571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222ae6-5e19-4aaa-82df-fe253be320d5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:50.941848 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222ae6-5e19-4aaa-82df-fe253be320d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:50.942227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222ae6-5e19-4aaa-82df-fe253be320d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:50.943009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2222ae6-5e19-4aaa-82df-fe253be320d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:50.943318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2222ae6-5e19-4aaa-82df-fe253be320d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:50.944860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2222ae6-5e19-4aaa-82df-fe253be320d5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:50.959693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 622/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:20:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:50.966167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5565d15-1903-4fc0-b2c6-49ac06c0493e None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:51.074324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5565d15-1903-4fc0-b2c6-49ac06c0493e None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:51.115637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a1808-1905-4336-ba14-fd65f5b73ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:51.116321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1808-1905-4336-ba14-fd65f5b73ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:51.116634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1808-1905-4336-ba14-fd65f5b73ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:51.116895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a1808-1905-4336-ba14-fd65f5b73ad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:51.117781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a1808-1905-4336-ba14-fd65f5b73ad0 None admin] RBAC: Adding query filter params (role.id=9802e06a85874fc98135684e38cb3a41, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=eb3ded7163fa400399d1b09079a366ed) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:51.118101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a1808-1905-4336-ba14-fd65f5b73ad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:51.119595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a1808-1905-4336-ba14-fd65f5b73ad0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:51.126008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 624/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:20:50 2022] GET /identity/v3/role_assignments?user.id=eb3ded7163fa400399d1b09079a366ed&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=9802e06a85874fc98135684e38cb3a41 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:53.411700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f393ee-4f6f-4dc0-9da8-8bda7325e708 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:53.412263 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f393ee-4f6f-4dc0-9da8-8bda7325e708 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:53.412347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f393ee-4f6f-4dc0-9da8-8bda7325e708 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:53.413858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 623/1247] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:20:53.419439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f7531-9ffb-4a50-a1e7-38063f07bc45 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:53.420017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f7531-9ffb-4a50-a1e7-38063f07bc45 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:53.420113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f7531-9ffb-4a50-a1e7-38063f07bc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:53.425818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:53.440117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5b2f7531-9ffb-4a50-a1e7-38063f07bc45 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:20:53.441335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5b2f7531-9ffb-4a50-a1e7-38063f07bc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:20:53.515321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 625/1248] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:20:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:20:53.540297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f393ee-4f6f-4dc0-9da8-8bda7325e708 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:53.565124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:53.668206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f393ee-4f6f-4dc0-9da8-8bda7325e708 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:53.711532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ab059-d903-45a5-a12a-835eb9f4ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:53.712410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ab059-d903-45a5-a12a-835eb9f4ec18 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:53.712729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ab059-d903-45a5-a12a-835eb9f4ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:53.713031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ab059-d903-45a5-a12a-835eb9f4ec18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:53.725503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ab059-d903-45a5-a12a-835eb9f4ec18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-ea8ab059-d903-45a5-a12a-835eb9f4ec18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:20:53.733775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:53.734953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:53.735804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 624/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:20:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:53.741994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f7531-9ffb-4a50-a1e7-38063f07bc45 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:53.853771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f7531-9ffb-4a50-a1e7-38063f07bc45 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:53.885960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:53.891391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f91bf-4010-4040-ae5f-3148ddcbf257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:53.892442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f91bf-4010-4040-ae5f-3148ddcbf257 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:53.893010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f91bf-4010-4040-ae5f-3148ddcbf257 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:53.893307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f91bf-4010-4040-ae5f-3148ddcbf257 None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:53.894323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f91bf-4010-4040-ae5f-3148ddcbf257 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:53.894634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f91bf-4010-4040-ae5f-3148ddcbf257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:53.896025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f91bf-4010-4040-ae5f-3148ddcbf257 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:53.910411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 626/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:20:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:53.911825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ab059-d903-45a5-a12a-835eb9f4ec18 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:54.002725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:54.034665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ab059-d903-45a5-a12a-835eb9f4ec18 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:54.071955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573863fb-ccc2-43b9-b4a9-092eb8cf2510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:54.072789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573863fb-ccc2-43b9-b4a9-092eb8cf2510 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:54.073103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573863fb-ccc2-43b9-b4a9-092eb8cf2510 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:54.073376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573863fb-ccc2-43b9-b4a9-092eb8cf2510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:54.085495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573863fb-ccc2-43b9-b4a9-092eb8cf2510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:54.087150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573863fb-ccc2-43b9-b4a9-092eb8cf2510 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-573863fb-ccc2-43b9-b4a9-092eb8cf2510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:54.105226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:54.106464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:54.107931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:54.107931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:54.107931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:54.107931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:54.107931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 625/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:20:54.112720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f91bf-4010-4040-ae5f-3148ddcbf257 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:54.237056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f91bf-4010-4040-ae5f-3148ddcbf257 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:54.276270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11339217-13a7-4ebf-b1a8-0aa7624ae6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:54.276877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11339217-13a7-4ebf-b1a8-0aa7624ae6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:54.277196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11339217-13a7-4ebf-b1a8-0aa7624ae6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:54.277492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11339217-13a7-4ebf-b1a8-0aa7624ae6b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:54.278368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11339217-13a7-4ebf-b1a8-0aa7624ae6b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:54.278818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11339217-13a7-4ebf-b1a8-0aa7624ae6b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:54.280188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11339217-13a7-4ebf-b1a8-0aa7624ae6b8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:54.297470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 627/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:54.303278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573863fb-ccc2-43b9-b4a9-092eb8cf2510 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:54.418830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573863fb-ccc2-43b9-b4a9-092eb8cf2510 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:54.459874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:54.467077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2908944-2dd5-4a55-ba32-b1a092883084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:54.468037 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2908944-2dd5-4a55-ba32-b1a092883084 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:54.468316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2908944-2dd5-4a55-ba32-b1a092883084 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:54.468583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2908944-2dd5-4a55-ba32-b1a092883084 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:54.477582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2908944-2dd5-4a55-ba32-b1a092883084 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:54.479179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2908944-2dd5-4a55-ba32-b1a092883084 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-f2908944-2dd5-4a55-ba32-b1a092883084 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:20:54.494463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:54.495867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:54.496812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 626/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:54.501926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11339217-13a7-4ebf-b1a8-0aa7624ae6b8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:54.571270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:54.630549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11339217-13a7-4ebf-b1a8-0aa7624ae6b8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:54.667929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0656d-8740-4cea-a487-40525303b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:54.668775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0656d-8740-4cea-a487-40525303b8ed None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:54.669420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0656d-8740-4cea-a487-40525303b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:54.669703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0656d-8740-4cea-a487-40525303b8ed None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:54.671008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0656d-8740-4cea-a487-40525303b8ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:54.671326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0656d-8740-4cea-a487-40525303b8ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:54.673048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0656d-8740-4cea-a487-40525303b8ed None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:54.693861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 628/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Fri Jul 1 16:20:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:54.699967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2908944-2dd5-4a55-ba32-b1a092883084 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:54.821763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2908944-2dd5-4a55-ba32-b1a092883084 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:54.860664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be40741-5115-4fa7-9d78-57db08974ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:54.861427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40741-5115-4fa7-9d78-57db08974ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:54.861767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40741-5115-4fa7-9d78-57db08974ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:54.862044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be40741-5115-4fa7-9d78-57db08974ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:54.922787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:54.939345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be40741-5115-4fa7-9d78-57db08974ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:54.940814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be40741-5115-4fa7-9d78-57db08974ac5 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:55.051354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 627/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:20:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 01 16:20:55.057576 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0656d-8740-4cea-a487-40525303b8ed None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:55.178575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0656d-8740-4cea-a487-40525303b8ed None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:55.196865 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:55.229578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85289d-b4ad-42ce-adec-2168503754db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:55.230481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85289d-b4ad-42ce-adec-2168503754db None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:55.230778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85289d-b4ad-42ce-adec-2168503754db None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:55.231080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85289d-b4ad-42ce-adec-2168503754db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:55.245791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85289d-b4ad-42ce-adec-2168503754db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:55.248622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85289d-b4ad-42ce-adec-2168503754db None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-4c85289d-b4ad-42ce-adec-2168503754db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:55.272982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:55.274097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:55.279725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:55.279725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:55.279725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:55.279725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:55.279725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 629/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:55.280192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be40741-5115-4fa7-9d78-57db08974ac5 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:55.385296 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:55.399353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be40741-5115-4fa7-9d78-57db08974ac5 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:55.443186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee3b2b-950d-486a-9bb8-ef90ff3d7d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:55.444045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee3b2b-950d-486a-9bb8-ef90ff3d7d54 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:55.444469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee3b2b-950d-486a-9bb8-ef90ff3d7d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:55.444981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee3b2b-950d-486a-9bb8-ef90ff3d7d54 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:55.446288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee3b2b-950d-486a-9bb8-ef90ff3d7d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:55.446818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee3b2b-950d-486a-9bb8-ef90ff3d7d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:55.449405 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee3b2b-950d-486a-9bb8-ef90ff3d7d54 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:55.464595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 628/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:55.470616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85289d-b4ad-42ce-adec-2168503754db None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:55.601497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85289d-b4ad-42ce-adec-2168503754db None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:55.642473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177757e0-6cfa-4251-8d17-5fb75e40c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:55.643282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177757e0-6cfa-4251-8d17-5fb75e40c35a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:55.643566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177757e0-6cfa-4251-8d17-5fb75e40c35a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:55.643843 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177757e0-6cfa-4251-8d17-5fb75e40c35a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:55.651201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177757e0-6cfa-4251-8d17-5fb75e40c35a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:55.652717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177757e0-6cfa-4251-8d17-5fb75e40c35a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-177757e0-6cfa-4251-8d17-5fb75e40c35a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:20:55.668600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:55.669925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:55.672278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:20:55.672278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:20:55.672278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:20:55.672278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:20:55.672278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:20:55.672278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:20:55.672278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:55.672278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:20:55.672278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 630/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:55.677057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee3b2b-950d-486a-9bb8-ef90ff3d7d54 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:55.788634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee3b2b-950d-486a-9bb8-ef90ff3d7d54 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:55.826115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7b881-7675-4b52-bfce-2ffb4cfccb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:55.826858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7b881-7675-4b52-bfce-2ffb4cfccb23 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:55.827474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7b881-7675-4b52-bfce-2ffb4cfccb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:55.827474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7b881-7675-4b52-bfce-2ffb4cfccb23 None admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:55.828341 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7b881-7675-4b52-bfce-2ffb4cfccb23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:55.828750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7b881-7675-4b52-bfce-2ffb4cfccb23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:55.830352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7b881-7675-4b52-bfce-2ffb4cfccb23 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:55.842436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 629/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:55.849515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177757e0-6cfa-4251-8d17-5fb75e40c35a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:55.877629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:55.966325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177757e0-6cfa-4251-8d17-5fb75e40c35a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:56.006765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a1ad-f51e-424b-805c-72b8790cf8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:56.007340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a1ad-f51e-424b-805c-72b8790cf8fd None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:56.007622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a1ad-f51e-424b-805c-72b8790cf8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:56.007897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a1ad-f51e-424b-805c-72b8790cf8fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:56.008725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a1ad-f51e-424b-805c-72b8790cf8fd None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=eb3ded7163fa400399d1b09079a366ed) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:56.009077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a1ad-f51e-424b-805c-72b8790cf8fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:56.011658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169a1ad-f51e-424b-805c-72b8790cf8fd None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:56.021417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 631/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:20:55 2022] GET /identity/v3/role_assignments?user.id=eb3ded7163fa400399d1b09079a366ed&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=842af9e8967047df873d061df391e820 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:58.127960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0d3c2-0024-469f-8bc8-316e9e32aa51 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:58.128524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0d3c2-0024-469f-8bc8-316e9e32aa51 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:58.128524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0d3c2-0024-469f-8bc8-316e9e32aa51 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:58.130702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 630/1261] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:20:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:20:58.139064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79951c-7dd4-41bd-b7bf-07a762c7ab5c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:58.139458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79951c-7dd4-41bd-b7bf-07a762c7ab5c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:58.139655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79951c-7dd4-41bd-b7bf-07a762c7ab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:58.167612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cb79951c-7dd4-41bd-b7bf-07a762c7ab5c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:20:58.168806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cb79951c-7dd4-41bd-b7bf-07a762c7ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:20:58.243830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 632/1262] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:20:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:20:58.266606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0d3c2-0024-469f-8bc8-316e9e32aa51 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:58.278462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:58.377072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0d3c2-0024-469f-8bc8-316e9e32aa51 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:58.412114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea1c0e-4c95-4d47-a087-69b3491c5455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:58.412837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea1c0e-4c95-4d47-a087-69b3491c5455 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:58.413155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea1c0e-4c95-4d47-a087-69b3491c5455 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:58.413425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea1c0e-4c95-4d47-a087-69b3491c5455 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:58.424197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea1c0e-4c95-4d47-a087-69b3491c5455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-0fea1c0e-4c95-4d47-a087-69b3491c5455 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:20:58.431822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:58.432956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:58.433993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 631/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:58.441213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79951c-7dd4-41bd-b7bf-07a762c7ab5c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:58.464165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:58.559238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79951c-7dd4-41bd-b7bf-07a762c7ab5c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:58.595625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195c925-4514-4c76-aba2-936266e8951a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:58.596284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195c925-4514-4c76-aba2-936266e8951a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:58.596558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195c925-4514-4c76-aba2-936266e8951a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:58.596822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195c925-4514-4c76-aba2-936266e8951a None admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:58.597589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195c925-4514-4c76-aba2-936266e8951a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:58.597954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195c925-4514-4c76-aba2-936266e8951a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:58.599720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195c925-4514-4c76-aba2-936266e8951a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:58.608231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 633/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:58.615078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea1c0e-4c95-4d47-a087-69b3491c5455 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:58.686577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:58.722756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea1c0e-4c95-4d47-a087-69b3491c5455 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:58.756948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60bf42-6ae2-424a-9792-06d31fbe795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:58.757751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60bf42-6ae2-424a-9792-06d31fbe795d None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:58.758028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60bf42-6ae2-424a-9792-06d31fbe795d None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:58.758298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60bf42-6ae2-424a-9792-06d31fbe795d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:58.769438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60bf42-6ae2-424a-9792-06d31fbe795d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:58.770902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60bf42-6ae2-424a-9792-06d31fbe795d None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-3c60bf42-6ae2-424a-9792-06d31fbe795d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:58.787956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:58.788986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:58.791975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:58.791975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:58.791975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:58.791975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:58.791975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 632/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:58.795758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195c925-4514-4c76-aba2-936266e8951a None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:58.885225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:58.919356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195c925-4514-4c76-aba2-936266e8951a None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:58.966038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2cc9-7b04-4ecb-8556-d45ddb101184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:58.966615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2cc9-7b04-4ecb-8556-d45ddb101184 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:58.966896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2cc9-7b04-4ecb-8556-d45ddb101184 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:58.967166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2cc9-7b04-4ecb-8556-d45ddb101184 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:58.967887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc2cc9-7b04-4ecb-8556-d45ddb101184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:58.968192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc2cc9-7b04-4ecb-8556-d45ddb101184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:58.969597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc2cc9-7b04-4ecb-8556-d45ddb101184 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:58.983371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 634/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:58.989429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60bf42-6ae2-424a-9792-06d31fbe795d None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:59.094843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60bf42-6ae2-424a-9792-06d31fbe795d None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:59.114646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:59.130269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d7504-cd66-4219-b04c-7567bfd5554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:59.131067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d7504-cd66-4219-b04c-7567bfd5554a None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:59.131345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d7504-cd66-4219-b04c-7567bfd5554a None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:59.131613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d7504-cd66-4219-b04c-7567bfd5554a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:59.139135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d7504-cd66-4219-b04c-7567bfd5554a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:59.140588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d7504-cd66-4219-b04c-7567bfd5554a None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-c38d7504-cd66-4219-b04c-7567bfd5554a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:20:59.154972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:59.156073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:59.157501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 633/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:59.162428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2cc9-7b04-4ecb-8556-d45ddb101184 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:59.275869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2cc9-7b04-4ecb-8556-d45ddb101184 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:59.311149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f88ff6-7080-402b-b170-7630cd2a87ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:59.311807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88ff6-7080-402b-b170-7630cd2a87ca None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:59.312096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88ff6-7080-402b-b170-7630cd2a87ca None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:59.312367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88ff6-7080-402b-b170-7630cd2a87ca None admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:59.313228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f88ff6-7080-402b-b170-7630cd2a87ca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:59.313533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f88ff6-7080-402b-b170-7630cd2a87ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:59.314977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f88ff6-7080-402b-b170-7630cd2a87ca None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:59.323509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:59.332813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 635/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Fri Jul 1 16:20:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:59.339059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d7504-cd66-4219-b04c-7567bfd5554a None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:59.446095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d7504-cd66-4219-b04c-7567bfd5554a None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:59.482469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f661e-9df8-4478-9871-241b079df0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:59.483257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f661e-9df8-4478-9871-241b079df0de None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:59.483540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f661e-9df8-4478-9871-241b079df0de None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:59.483813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f661e-9df8-4478-9871-241b079df0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:59.494659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f661e-9df8-4478-9871-241b079df0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:59.496793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f661e-9df8-4478-9871-241b079df0de None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-968f661e-9df8-4478-9871-241b079df0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:20:59.517758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:59.518782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:59.519711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:20:59.519711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:20:59.519711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:20:59.519711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:59.519711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 634/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:59.525254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f88ff6-7080-402b-b170-7630cd2a87ca None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:59.630146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f88ff6-7080-402b-b170-7630cd2a87ca None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:59.669281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e09598-ad31-4f1c-89ee-2976524128c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:59.669936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e09598-ad31-4f1c-89ee-2976524128c2 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:59.670218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e09598-ad31-4f1c-89ee-2976524128c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:59.670494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e09598-ad31-4f1c-89ee-2976524128c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:59.671211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e09598-ad31-4f1c-89ee-2976524128c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:20:59.671520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e09598-ad31-4f1c-89ee-2976524128c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:59.672891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e09598-ad31-4f1c-89ee-2976524128c2 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:59.684689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 636/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:20:59.690841 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f661e-9df8-4478-9871-241b079df0de None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:59.729334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:59.803929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f661e-9df8-4478-9871-241b079df0de None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:20:59.839268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cc34b-03be-40ae-80e6-180b2703fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:20:59.840056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cc34b-03be-40ae-80e6-180b2703fce0 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:20:59.840334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cc34b-03be-40ae-80e6-180b2703fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:20:59.840607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cc34b-03be-40ae-80e6-180b2703fce0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:20:59.847708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cc34b-03be-40ae-80e6-180b2703fce0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:20:59.849562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cc34b-03be-40ae-80e6-180b2703fce0 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-660cc34b-03be-40ae-80e6-180b2703fce0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:20:59.863718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:20:59.864776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:20:59.865918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:20:59.865918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:20:59.865918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:20:59.865918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:20:59.865918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:20:59.865918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:20:59.865918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:20:59.865918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:20:59.865918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 635/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:20:59.871114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e09598-ad31-4f1c-89ee-2976524128c2 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:20:59.933769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:20:59.981452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e09598-ad31-4f1c-89ee-2976524128c2 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:00.016982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e42a2-7615-47fd-8ff3-122a1d17836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:00.017638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e42a2-7615-47fd-8ff3-122a1d17836a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:00.017921 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e42a2-7615-47fd-8ff3-122a1d17836a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:00.018197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e42a2-7615-47fd-8ff3-122a1d17836a None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:00.018972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e42a2-7615-47fd-8ff3-122a1d17836a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:00.019282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e42a2-7615-47fd-8ff3-122a1d17836a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:00.020714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e42a2-7615-47fd-8ff3-122a1d17836a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:00.032932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 637/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:21:00.042535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cc34b-03be-40ae-80e6-180b2703fce0 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:00.153768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:00.163653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cc34b-03be-40ae-80e6-180b2703fce0 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:00.198468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919b959-98e8-40df-8853-641a4eb9d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:00.199289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919b959-98e8-40df-8853-641a4eb9d2e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:00.199567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919b959-98e8-40df-8853-641a4eb9d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:00.199834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919b959-98e8-40df-8853-641a4eb9d2e9 None admin] PATH_INFO: `/v3/projects/346384d95ea34feca944fbe147c50aa8/users/eb3ded7163fa400399d1b09079a366ed/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:00.202079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919b959-98e8-40df-8853-641a4eb9d2e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=346384d95ea34feca944fbe147c50aa8, user_id=eb3ded7163fa400399d1b09079a366ed, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:00.203534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919b959-98e8-40df-8853-641a4eb9d2e9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:00.220965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 636/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Fri Jul 1 16:21:00 2022] PUT /identity/v3/projects/346384d95ea34feca944fbe147c50aa8/users/eb3ded7163fa400399d1b09079a366ed/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:21:02.275652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0aa2-3245-4958-9d58-2be54e30e2cf None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:02.276583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0aa2-3245-4958-9d58-2be54e30e2cf None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:02.276583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a0aa2-3245-4958-9d58-2be54e30e2cf None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:02.278711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 638/1274] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:21:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:21:02.287803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0ea69-2e2e-4da2-8142-dfbded8949fb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:02.288577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0ea69-2e2e-4da2-8142-dfbded8949fb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:02.288770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0ea69-2e2e-4da2-8142-dfbded8949fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:02.313418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e7e0ea69-2e2e-4da2-8142-dfbded8949fb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:21:02.314613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e7e0ea69-2e2e-4da2-8142-dfbded8949fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:21:02.386532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 637/1275] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:21:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:21:02.415846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a0aa2-3245-4958-9d58-2be54e30e2cf None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:02.525858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a0aa2-3245-4958-9d58-2be54e30e2cf None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:02.545261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:02.563245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537f30-5cba-4813-8395-f7d530c0a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:02.564044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537f30-5cba-4813-8395-f7d530c0a455 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:02.564327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537f30-5cba-4813-8395-f7d530c0a455 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:02.564601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537f30-5cba-4813-8395-f7d530c0a455 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:02.576178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537f30-5cba-4813-8395-f7d530c0a455 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-af537f30-5cba-4813-8395-f7d530c0a455 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 01 16:21:02.583738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:21:02.584740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:02.585765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 639/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Fri Jul 1 16:21:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:21:02.593374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0ea69-2e2e-4da2-8142-dfbded8949fb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:02.675546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:02.696130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0ea69-2e2e-4da2-8142-dfbded8949fb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:02.730142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b177f-dfbb-4197-8d59-694a68b51095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:02.730805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b177f-dfbb-4197-8d59-694a68b51095 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:02.731089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b177f-dfbb-4197-8d59-694a68b51095 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:02.731368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b177f-dfbb-4197-8d59-694a68b51095 None admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:02.732128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b177f-dfbb-4197-8d59-694a68b51095 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:02.732437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b177f-dfbb-4197-8d59-694a68b51095 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:02.733867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b177f-dfbb-4197-8d59-694a68b51095 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:02.742253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 638/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Fri Jul 1 16:21:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:02.749256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537f30-5cba-4813-8395-f7d530c0a455 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:02.851586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537f30-5cba-4813-8395-f7d530c0a455 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:02.885437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0369fa-7a93-412d-a49a-1af16009f4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:02.886225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0369fa-7a93-412d-a49a-1af16009f4de None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:02.886503 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0369fa-7a93-412d-a49a-1af16009f4de None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:02.886783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0369fa-7a93-412d-a49a-1af16009f4de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:02.897277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0369fa-7a93-412d-a49a-1af16009f4de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:02.898733 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0369fa-7a93-412d-a49a-1af16009f4de None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-aa0369fa-7a93-412d-a49a-1af16009f4de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:21:02.915418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:21:02.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:21:02.917415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:21:02.917415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:21:02.917415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:21:02.917415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:02.917415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 640/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:21:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:21:02.923340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b177f-dfbb-4197-8d59-694a68b51095 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:03.030512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b177f-dfbb-4197-8d59-694a68b51095 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:03.067750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8279-14c9-42bf-ae0c-b797072cf290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:03.068407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8279-14c9-42bf-ae0c-b797072cf290 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:03.068700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8279-14c9-42bf-ae0c-b797072cf290 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:03.069013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8279-14c9-42bf-ae0c-b797072cf290 None admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:03.069742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8279-14c9-42bf-ae0c-b797072cf290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:03.070046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8279-14c9-42bf-ae0c-b797072cf290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:03.071427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8279-14c9-42bf-ae0c-b797072cf290 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:03.085310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 639/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:03.091651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0369fa-7a93-412d-a49a-1af16009f4de None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:03.125904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:03.196892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0369fa-7a93-412d-a49a-1af16009f4de None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:03.232144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d343d-8bf1-4d06-b499-3a347890c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:03.232958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d343d-8bf1-4d06-b499-3a347890c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:03.233244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d343d-8bf1-4d06-b499-3a347890c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:03.233513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d343d-8bf1-4d06-b499-3a347890c8a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:03.241231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d343d-8bf1-4d06-b499-3a347890c8a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:03.242681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d343d-8bf1-4d06-b499-3a347890c8a5 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-524d343d-8bf1-4d06-b499-3a347890c8a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 01 16:21:03.256988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:21:03.258061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:03.259488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 641/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:21:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:21:03.264309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8279-14c9-42bf-ae0c-b797072cf290 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:03.268393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:03.383435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8279-14c9-42bf-ae0c-b797072cf290 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:03.419538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1def-e1e3-4fe3-9f20-7b518fc80b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:03.420203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1def-e1e3-4fe3-9f20-7b518fc80b90 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:03.420486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1def-e1e3-4fe3-9f20-7b518fc80b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:03.420763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f1def-e1e3-4fe3-9f20-7b518fc80b90 None admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:03.421635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f1def-e1e3-4fe3-9f20-7b518fc80b90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:03.421950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f1def-e1e3-4fe3-9f20-7b518fc80b90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:03.423390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f1def-e1e3-4fe3-9f20-7b518fc80b90 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:03.442380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 640/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Fri Jul 1 16:21:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:03.448803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d343d-8bf1-4d06-b499-3a347890c8a5 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:03.544218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:03.555092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d343d-8bf1-4d06-b499-3a347890c8a5 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:03.592633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a4bf-6bdc-4585-955a-9801883ae4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:03.593319 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a4bf-6bdc-4585-955a-9801883ae4cf None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:03.593602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a4bf-6bdc-4585-955a-9801883ae4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:03.593881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a4bf-6bdc-4585-955a-9801883ae4cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:03.663134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a4bf-6bdc-4585-955a-9801883ae4cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:03.664526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a4bf-6bdc-4585-955a-9801883ae4cf None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:03.760188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:03.772096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 642/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Fri Jul 1 16:21:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 01 16:21:03.778171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1def-e1e3-4fe3-9f20-7b518fc80b90 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:03.841475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:03.883110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f1def-e1e3-4fe3-9f20-7b518fc80b90 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:03.918716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4c48-5b4b-455e-a905-c120cf30d0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:03.919436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4c48-5b4b-455e-a905-c120cf30d0db None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:03.919714 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4c48-5b4b-455e-a905-c120cf30d0db None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:03.919982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f4c48-5b4b-455e-a905-c120cf30d0db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:03.930692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f4c48-5b4b-455e-a905-c120cf30d0db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:03.932173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f4c48-5b4b-455e-a905-c120cf30d0db None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-831f4c48-5b4b-455e-a905-c120cf30d0db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 01 16:21:03.951273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:21:03.952220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:21:03.953166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 01 16:21:03.953166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 01 16:21:03.953166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 01 16:21:03.953166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:21:03.953166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 641/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:21:03.958490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a4bf-6bdc-4585-955a-9801883ae4cf None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:04.060376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a4bf-6bdc-4585-955a-9801883ae4cf None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:04.102315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460b39-2f22-4098-9bf8-878b9a292ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:04.102974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460b39-2f22-4098-9bf8-878b9a292ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:04.103252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460b39-2f22-4098-9bf8-878b9a292ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:04.103520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd460b39-2f22-4098-9bf8-878b9a292ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:04.104301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd460b39-2f22-4098-9bf8-878b9a292ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:04.104604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd460b39-2f22-4098-9bf8-878b9a292ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:04.106072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd460b39-2f22-4098-9bf8-878b9a292ad8 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:04.117446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 643/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Fri Jul 1 16:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:04.123529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4c48-5b4b-455e-a905-c120cf30d0db None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:04.242506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f4c48-5b4b-455e-a905-c120cf30d0db None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:04.258238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:04.279321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1ee8b-4aa6-4000-9845-a33c9fb6f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:04.280108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1ee8b-4aa6-4000-9845-a33c9fb6f88e None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:04.280390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1ee8b-4aa6-4000-9845-a33c9fb6f88e None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:04.280663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1ee8b-4aa6-4000-9845-a33c9fb6f88e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:04.287335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1ee8b-4aa6-4000-9845-a33c9fb6f88e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:04.288803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1ee8b-4aa6-4000-9845-a33c9fb6f88e None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application [None req-2cb1ee8b-4aa6-4000-9845-a33c9fb6f88e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 01 16:21:04.310506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application with Lock( Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:21:04.311558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:21:04.312629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 01 16:21:04.312629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 01 16:21:04.312629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 01 16:21:04.312629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 01 16:21:04.312629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 01 16:21:04.312629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 01 16:21:04.312629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 01 16:21:04.312629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: ERROR keystone.server.flask.application Jul 01 16:21:04.313377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 642/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Fri Jul 1 16:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 01 16:21:04.319635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460b39-2f22-4098-9bf8-878b9a292ad8 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:04.377027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:04.434531 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd460b39-2f22-4098-9bf8-878b9a292ad8 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:04.472093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130ea7c-f662-4961-ada4-ab8aca2b4d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:04.472706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130ea7c-f662-4961-ada4-ab8aca2b4d62 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:04.473363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130ea7c-f662-4961-ada4-ab8aca2b4d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:04.473637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130ea7c-f662-4961-ada4-ab8aca2b4d62 None admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:04.474402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130ea7c-f662-4961-ada4-ab8aca2b4d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:04.474706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130ea7c-f662-4961-ada4-ab8aca2b4d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:04.476183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130ea7c-f662-4961-ada4-ab8aca2b4d62 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:04.489842 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 644/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Fri Jul 1 16:21:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:21:04.497948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1ee8b-4aa6-4000-9845-a33c9fb6f88e None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:04.604818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1ee8b-4aa6-4000-9845-a33c9fb6f88e None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:04.643404 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca18b8-b2cd-408a-9a95-63a8c9cc3dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:04.644055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca18b8-b2cd-408a-9a95-63a8c9cc3dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:04.644336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca18b8-b2cd-408a-9a95-63a8c9cc3dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:04.644605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca18b8-b2cd-408a-9a95-63a8c9cc3dd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:04.645468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca18b8-b2cd-408a-9a95-63a8c9cc3dd9 None admin] RBAC: Adding query filter params (role.id=842af9e8967047df873d061df391e820, scope.project.id=346384d95ea34feca944fbe147c50aa8, user.id=eb3ded7163fa400399d1b09079a366ed) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:04.645781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca18b8-b2cd-408a-9a95-63a8c9cc3dd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:04.647248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca18b8-b2cd-408a-9a95-63a8c9cc3dd9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:04.655346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 643/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Fri Jul 1 16:21:04 2022] GET /identity/v3/role_assignments?user.id=eb3ded7163fa400399d1b09079a366ed&scope.project.id=346384d95ea34feca944fbe147c50aa8&role.id=842af9e8967047df873d061df391e820 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:06.689650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac5299-a204-4574-a385-f7f2e51d6256 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:06.690672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac5299-a204-4574-a385-f7f2e51d6256 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:06.690672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac5299-a204-4574-a385-f7f2e51d6256 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:06.692747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 645/1288] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:21:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:21:06.701083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec502c-5cb4-4988-a698-338748b28d7e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:06.701553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec502c-5cb4-4988-a698-338748b28d7e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:06.701656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec502c-5cb4-4988-a698-338748b28d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:06.720545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b6ec502c-5cb4-4988-a698-338748b28d7e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:21:06.721759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b6ec502c-5cb4-4988-a698-338748b28d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:21:06.757996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:06.798018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 644/1289] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:21:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:21:06.821041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac5299-a204-4574-a385-f7f2e51d6256 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:06.931339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac5299-a204-4574-a385-f7f2e51d6256 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:06.942217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:06.979895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e941-171e-4868-b5a0-4f2c465f96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:06.980687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e941-171e-4868-b5a0-4f2c465f96a0 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:06.981004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e941-171e-4868-b5a0-4f2c465f96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:06.981276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367e941-171e-4868-b5a0-4f2c465f96a0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:06.981923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367e941-171e-4868-b5a0-4f2c465f96a0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:06.983292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367e941-171e-4868-b5a0-4f2c465f96a0 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-0367e941-171e-4868-b5a0-4f2c465f96a0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:21:06.995134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:21:06.996237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:06.997332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 646/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:21:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:21:07.004635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec502c-5cb4-4988-a698-338748b28d7e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:07.114895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec502c-5cb4-4988-a698-338748b28d7e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:07.152157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6c42f9-7ba2-4b4d-9a1d-01ed3b508ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:07.152826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c42f9-7ba2-4b4d-9a1d-01ed3b508ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:07.153140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c42f9-7ba2-4b4d-9a1d-01ed3b508ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:07.153419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6c42f9-7ba2-4b4d-9a1d-01ed3b508ce7 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:07.154128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c42f9-7ba2-4b4d-9a1d-01ed3b508ce7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:07.154434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c42f9-7ba2-4b4d-9a1d-01ed3b508ce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:07.155834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6c42f9-7ba2-4b4d-9a1d-01ed3b508ce7 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:07.161076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 645/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Fri Jul 1 16:21:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:07.167911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e941-171e-4868-b5a0-4f2c465f96a0 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:07.282518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367e941-171e-4868-b5a0-4f2c465f96a0 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:07.328021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290e9ffe-0f61-406f-aacb-d51f13171749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:07.328545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9ffe-0f61-406f-aacb-d51f13171749 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:07.328832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9ffe-0f61-406f-aacb-d51f13171749 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:07.329139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290e9ffe-0f61-406f-aacb-d51f13171749 None admin] PATH_INFO: `/v3/services` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:07.329855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9ffe-0f61-406f-aacb-d51f13171749 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:07.330164 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9ffe-0f61-406f-aacb-d51f13171749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:07.331773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290e9ffe-0f61-406f-aacb-d51f13171749 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:07.336642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 647/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Fri Jul 1 16:21:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:09.314490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89faf22-269c-4d25-bde2-c3c7e0075438 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:09.315081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89faf22-269c-4d25-bde2-c3c7e0075438 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:09.315081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89faf22-269c-4d25-bde2-c3c7e0075438 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:09.316414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 646/1293] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:21:09.322853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0417d-b777-4d81-993e-b8e8e65aab9a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:09.323294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0417d-b777-4d81-993e-b8e8e65aab9a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:09.323433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0417d-b777-4d81-993e-b8e8e65aab9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:09.352808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8fb0417d-b777-4d81-993e-b8e8e65aab9a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:21:09.354437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8fb0417d-b777-4d81-993e-b8e8e65aab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:21:09.387571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:09.434599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 648/1294] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:21:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:21:09.457903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89faf22-269c-4d25-bde2-c3c7e0075438 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:09.492563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:09.567523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89faf22-269c-4d25-bde2-c3c7e0075438 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:09.606577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f888c-bca1-463d-a25e-bfa684b5ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:09.607241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f888c-bca1-463d-a25e-bfa684b5ece9 None admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:09.607525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f888c-bca1-463d-a25e-bfa684b5ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:09.607801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f888c-bca1-463d-a25e-bfa684b5ece9 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:09.608524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f888c-bca1-463d-a25e-bfa684b5ece9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:09.609950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f888c-bca1-463d-a25e-bfa684b5ece9 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:09.626469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 647/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Fri Jul 1 16:21:09 2022] POST /identity/v3/services => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:21:11.631595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba1308-e09f-4ca3-89d5-17f94ddda022 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:11.632210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba1308-e09f-4ca3-89d5-17f94ddda022 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:11.632210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba1308-e09f-4ca3-89d5-17f94ddda022 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:11.633591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 649/1296] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:21:11.639923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e901f-5351-4351-9524-7dc968e96130 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:11.640616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e901f-5351-4351-9524-7dc968e96130 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:11.640798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e901f-5351-4351-9524-7dc968e96130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:11.669294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cc5e901f-5351-4351-9524-7dc968e96130 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:21:11.670505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cc5e901f-5351-4351-9524-7dc968e96130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:21:11.749768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 648/1297] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:21:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 01 16:21:11.776570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba1308-e09f-4ca3-89d5-17f94ddda022 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:11.886716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba1308-e09f-4ca3-89d5-17f94ddda022 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:11.923211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f630b-6d09-4501-90c7-48a6187e7335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:11.923993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f630b-6d09-4501-90c7-48a6187e7335 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:11.924270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f630b-6d09-4501-90c7-48a6187e7335 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:11.924538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f630b-6d09-4501-90c7-48a6187e7335 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:11.925214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f630b-6d09-4501-90c7-48a6187e7335 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:11.926704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f630b-6d09-4501-90c7-48a6187e7335 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-a23f630b-6d09-4501-90c7-48a6187e7335 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:21:11.939161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:21:11.940316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:11.941226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 650/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:21:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:21:11.946525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e901f-5351-4351-9524-7dc968e96130 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:11.966599 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:12.050495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e901f-5351-4351-9524-7dc968e96130 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:12.090242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8c5ed-cdb9-4a9f-bad2-8a9f95b68ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:12.090894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8c5ed-cdb9-4a9f-bad2-8a9f95b68ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:12.091178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8c5ed-cdb9-4a9f-bad2-8a9f95b68ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:12.091452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8c5ed-cdb9-4a9f-bad2-8a9f95b68ab6 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:12.092158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8c5ed-cdb9-4a9f-bad2-8a9f95b68ab6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:12.092468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8c5ed-cdb9-4a9f-bad2-8a9f95b68ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:12.093892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8c5ed-cdb9-4a9f-bad2-8a9f95b68ab6 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:12.099553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 649/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Fri Jul 1 16:21:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:12.105929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f630b-6d09-4501-90c7-48a6187e7335 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:12.138736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:12.208629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f630b-6d09-4501-90c7-48a6187e7335 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:12.244206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9baeb-db41-40ab-b1d7-813b76cf7a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:12.244889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9baeb-db41-40ab-b1d7-813b76cf7a5a None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:12.245191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9baeb-db41-40ab-b1d7-813b76cf7a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:12.245456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9baeb-db41-40ab-b1d7-813b76cf7a5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:12.246240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9baeb-db41-40ab-b1d7-813b76cf7a5a None admin] RBAC: Adding query filter params (interface=public, service_id=1b15ce3b6f7641a0a61ff3527ed78aa1, region_id=RegionOne) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:12.246546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9baeb-db41-40ab-b1d7-813b76cf7a5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:12.247918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9baeb-db41-40ab-b1d7-813b76cf7a5a None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:12.253036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 651/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Fri Jul 1 16:21:12 2022] GET /identity/v3/endpoints?service_id=1b15ce3b6f7641a0a61ff3527ed78aa1&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:12.259581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8c5ed-cdb9-4a9f-bad2-8a9f95b68ab6 None admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:12.346875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:12.367021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8c5ed-cdb9-4a9f-bad2-8a9f95b68ab6 None admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:12.409385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e52bc-8537-4f55-a11c-cc1a5f8f8ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:12.409984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e52bc-8537-4f55-a11c-cc1a5f8f8ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:12.410288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e52bc-8537-4f55-a11c-cc1a5f8f8ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:12.410566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e52bc-8537-4f55-a11c-cc1a5f8f8ea4 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:12.411255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e52bc-8537-4f55-a11c-cc1a5f8f8ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:12.412658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e52bc-8537-4f55-a11c-cc1a5f8f8ea4 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:12.420084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 650/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Fri Jul 1 16:21:12 2022] GET /identity/v3/services => generated 2191 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:21:14.425776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df0989-946b-4aa3-92fa-0eac109a85de None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:14.426718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df0989-946b-4aa3-92fa-0eac109a85de None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:14.426718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df0989-946b-4aa3-92fa-0eac109a85de None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:14.428899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 652/1302] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:21:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:21:14.436750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf57d77-910c-439a-8eee-c436a90b0bad None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:14.437211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf57d77-910c-439a-8eee-c436a90b0bad None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:14.437317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf57d77-910c-439a-8eee-c436a90b0bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:14.456140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ecf57d77-910c-439a-8eee-c436a90b0bad None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:21:14.457362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ecf57d77-910c-439a-8eee-c436a90b0bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:21:14.525928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 651/1303] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:21:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 01 16:21:14.554749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df0989-946b-4aa3-92fa-0eac109a85de None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:14.661569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:14.669700 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df0989-946b-4aa3-92fa-0eac109a85de None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:14.706917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0be088-e503-4302-843f-bdb7d45168b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:14.707650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0be088-e503-4302-843f-bdb7d45168b1 None admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:14.707932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0be088-e503-4302-843f-bdb7d45168b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:14.708204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0be088-e503-4302-843f-bdb7d45168b1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:14.708876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0be088-e503-4302-843f-bdb7d45168b1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:14.710257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0be088-e503-4302-843f-bdb7d45168b1 None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application [None req-6a0be088-e503-4302-843f-bdb7d45168b1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 01 16:21:14.727327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 01 16:21:14.728382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.get_or_create( Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application with Lock( Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self._enter() Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application return self.creator() Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application created_value = creator( Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: ERROR keystone.server.flask.application Jul 01 16:21:14.729468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 653/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Fri Jul 1 16:21:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 01 16:21:14.735727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf57d77-910c-439a-8eee-c436a90b0bad None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:14.818704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:14.843803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf57d77-910c-439a-8eee-c436a90b0bad None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:14.878769 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cce321-f22e-448a-9ede-3b587967cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:14.879521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cce321-f22e-448a-9ede-3b587967cf78 None admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:14.879795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cce321-f22e-448a-9ede-3b587967cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:14.880069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cce321-f22e-448a-9ede-3b587967cf78 None admin] PATH_INFO: `/v3/services` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:14.880784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cce321-f22e-448a-9ede-3b587967cf78 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:21:14.881108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cce321-f22e-448a-9ede-3b587967cf78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:14.882496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cce321-f22e-448a-9ede-3b587967cf78 None admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:14.887735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 652/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Fri Jul 1 16:21:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:21:14.893816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0be088-e503-4302-843f-bdb7d45168b1 None admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:21:14.997843 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0be088-e503-4302-843f-bdb7d45168b1 None admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:21:15.038098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f60ba-c5b8-4c0f-8b2f-4e327d81916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:21:15.039069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f60ba-c5b8-4c0f-8b2f-4e327d81916e None admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:21:15.039512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f60ba-c5b8-4c0f-8b2f-4e327d81916e None admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:21:15.039943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f60ba-c5b8-4c0f-8b2f-4e327d81916e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:21:15.041216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f60ba-c5b8-4c0f-8b2f-4e327d81916e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:21:15.043429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676f60ba-c5b8-4c0f-8b2f-4e327d81916e None admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:21:15.070964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 654/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Fri Jul 1 16:21:14 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:21:24.884551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=30 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:21:25.066841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:17.910105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9d2af-05d0-4a3a-9275-1c98c2b2e367 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:17.910691 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9d2af-05d0-4a3a-9275-1c98c2b2e367 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:17.910691 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9d2af-05d0-4a3a-9275-1c98c2b2e367 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:17.917325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5fb74-817e-47ea-a8ba-132f65befaeb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:17.917816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5fb74-817e-47ea-a8ba-132f65befaeb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:17.917903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5fb74-817e-47ea-a8ba-132f65befaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:17.921543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 653/1307] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:18.001631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a3f5fb74-817e-47ea-a8ba-132f65befaeb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:18.002745 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a3f5fb74-817e-47ea-a8ba-132f65befaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:18.113558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 655/1308] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:18.172366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dc345-a089-4819-b461-5c9079a5663e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:18.173876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dc345-a089-4819-b461-5c9079a5663e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:18.174999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75dc345-a089-4819-b461-5c9079a5663e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:18.181275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 654/1309] 10.222.0.59 () {54 vars in 964 bytes} [Fri Jul 1 16:22:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:18.186673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eed3fe-edff-4a4b-a6bc-92f00b8b9192 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:18.186946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eed3fe-edff-4a4b-a6bc-92f00b8b9192 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:18.187209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eed3fe-edff-4a4b-a6bc-92f00b8b9192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:18.319011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-76eed3fe-edff-4a4b-a6bc-92f00b8b9192 None None] MFA Rules not processed for user `11785acde2f74ad481d1224f2a7fd296`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:18.320628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-76eed3fe-edff-4a4b-a6bc-92f00b8b9192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:18.346398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:18.418943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 656/1310] 10.222.0.59 () {58 vars in 1061 bytes} [Fri Jul 1 16:22:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:18.427817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dc345-a089-4819-b461-5c9079a5663e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:18.429684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f75dc345-a089-4819-b461-5c9079a5663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:18.575755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75dc345-a089-4819-b461-5c9079a5663e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:18.655598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d7862-325b-4d21-97c3-4b6bee258222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:18.656715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d7862-325b-4d21-97c3-4b6bee258222 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:18.657240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d7862-325b-4d21-97c3-4b6bee258222 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:18.657717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d7862-325b-4d21-97c3-4b6bee258222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:18.659726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f98d7862-325b-4d21-97c3-4b6bee258222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:18.717381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:18.778241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d7862-325b-4d21-97c3-4b6bee258222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:18.780120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d7862-325b-4d21-97c3-4b6bee258222 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:18.800358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 655/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:21.153656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4239-3791-4903-8c11-684036f41181 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:21.154285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4239-3791-4903-8c11-684036f41181 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:21.154285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c4239-3791-4903-8c11-684036f41181 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:21.155674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 657/1312] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:21.161106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911d3e-f12a-4c79-8ff9-733d61897828 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:21.161855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911d3e-f12a-4c79-8ff9-733d61897828 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:21.162137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9911d3e-f12a-4c79-8ff9-733d61897828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:21.237465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c9911d3e-f12a-4c79-8ff9-733d61897828 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:21.238713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c9911d3e-f12a-4c79-8ff9-733d61897828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:21.346909 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 656/1313] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:21.386636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c4239-3791-4903-8c11-684036f41181 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:21.388270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a02c4239-3791-4903-8c11-684036f41181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:21.497273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c4239-3791-4903-8c11-684036f41181 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:21.571714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:21.575702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75f810-f643-4a65-b6e0-0b8150d168f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:21.576587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f810-f643-4a65-b6e0-0b8150d168f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:21.577005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f810-f643-4a65-b6e0-0b8150d168f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:21.577376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75f810-f643-4a65-b6e0-0b8150d168f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:21.579957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ed75f810-f643-4a65-b6e0-0b8150d168f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:21.704686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75f810-f643-4a65-b6e0-0b8150d168f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:21.706232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75f810-f643-4a65-b6e0-0b8150d168f4 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:21.727059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 658/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:24.038688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eece2-76c6-4ceb-80cf-5634cc8fd95d None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:24.039181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eece2-76c6-4ceb-80cf-5634cc8fd95d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:24.039181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eece2-76c6-4ceb-80cf-5634cc8fd95d None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:24.041384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 657/1315] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:24.050424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9b773-03a6-4067-b18e-45f8eef233ed None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:24.050826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9b773-03a6-4067-b18e-45f8eef233ed None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:24.051078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9b773-03a6-4067-b18e-45f8eef233ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:24.126328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8da9b773-03a6-4067-b18e-45f8eef233ed None None] MFA Rules not processed for user `b6c16790bfc747a1a44c51bfa8616856`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:24.127578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8da9b773-03a6-4067-b18e-45f8eef233ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:24.189664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:24.234873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 659/1316] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:24.280881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eece2-76c6-4ceb-80cf-5634cc8fd95d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:24.282502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3e1eece2-76c6-4ceb-80cf-5634cc8fd95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:24.292865 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:24.404420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eece2-76c6-4ceb-80cf-5634cc8fd95d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:24.479844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3819bc-231f-4a3b-891a-66f441361e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:24.480489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3819bc-231f-4a3b-891a-66f441361e1d service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:24.480764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3819bc-231f-4a3b-891a-66f441361e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:24.481067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3819bc-231f-4a3b-891a-66f441361e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:24.482716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9f3819bc-231f-4a3b-891a-66f441361e1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:24.545117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:24.590560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3819bc-231f-4a3b-891a-66f441361e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:24.592015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3819bc-231f-4a3b-891a-66f441361e1d service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:24.611306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 658/1317] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:22:27.192436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbdf10-80e2-4807-9331-9ea89d297e5e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:27.193032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbdf10-80e2-4807-9331-9ea89d297e5e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:27.193032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbdf10-80e2-4807-9331-9ea89d297e5e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:27.194490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 660/1318] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:27.200902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4089a-db79-41ea-b25b-8deb9803d1a1 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:27.201581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4089a-db79-41ea-b25b-8deb9803d1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:27.201981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4089a-db79-41ea-b25b-8deb9803d1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:27.282254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-05e4089a-db79-41ea-b25b-8deb9803d1a1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:27.283477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-05e4089a-db79-41ea-b25b-8deb9803d1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:27.387397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 659/1319] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:27.429310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbdf10-80e2-4807-9331-9ea89d297e5e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:27.430866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-98dbdf10-80e2-4807-9331-9ea89d297e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:27.554669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbdf10-80e2-4807-9331-9ea89d297e5e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:27.630473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e83ac-7d3d-4c1c-a380-9d2eae32dccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:27.631118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e83ac-7d3d-4c1c-a380-9d2eae32dccd service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:27.631400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e83ac-7d3d-4c1c-a380-9d2eae32dccd service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:27.631674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e83ac-7d3d-4c1c-a380-9d2eae32dccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:27.633347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-aa4e83ac-7d3d-4c1c-a380-9d2eae32dccd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:27.641299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:27.756323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e83ac-7d3d-4c1c-a380-9d2eae32dccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:27.757812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e83ac-7d3d-4c1c-a380-9d2eae32dccd service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:27.779562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 661/1320] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:30.467042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fefdf-3f93-4566-b13f-7b649cbf5a40 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:30.467598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fefdf-3f93-4566-b13f-7b649cbf5a40 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:30.467598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fefdf-3f93-4566-b13f-7b649cbf5a40 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:30.469486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 660/1321] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:30.474947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86939d-8fa5-4ff2-9e0b-aa41cf8b1a84 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:30.475367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86939d-8fa5-4ff2-9e0b-aa41cf8b1a84 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:30.475454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86939d-8fa5-4ff2-9e0b-aa41cf8b1a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:30.548879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fd86939d-8fa5-4ff2-9e0b-aa41cf8b1a84 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:30.550126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fd86939d-8fa5-4ff2-9e0b-aa41cf8b1a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:30.611530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:30.656880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 662/1322] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:22:30.705573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0f83-2c80-43f9-af9b-f80695df4dc1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:30.706000 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0f83-2c80-43f9-af9b-f80695df4dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:30.706271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb0f83-2c80-43f9-af9b-f80695df4dc1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:30.707708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 661/1323] 10.222.0.59 () {54 vars in 964 bytes} [Fri Jul 1 16:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:30.714448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12184af8-25fb-41c2-b189-633494023379 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:30.714707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12184af8-25fb-41c2-b189-633494023379 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:30.715005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12184af8-25fb-41c2-b189-633494023379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:30.803570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-12184af8-25fb-41c2-b189-633494023379 None None] MFA Rules not processed for user `11785acde2f74ad481d1224f2a7fd296`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:30.804824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-12184af8-25fb-41c2-b189-633494023379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:30.887134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 663/1324] 10.222.0.59 () {58 vars in 1061 bytes} [Fri Jul 1 16:22:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:30.896202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb0f83-2c80-43f9-af9b-f80695df4dc1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:30.897778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-95cb0f83-2c80-43f9-af9b-f80695df4dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:30.917771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:31.006351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb0f83-2c80-43f9-af9b-f80695df4dc1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:31.081378 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a08c2-52fb-4832-8264-6bd37af93eb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:31.081928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a08c2-52fb-4832-8264-6bd37af93eb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:31.082206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a08c2-52fb-4832-8264-6bd37af93eb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:31.082475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a08c2-52fb-4832-8264-6bd37af93eb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:31.084120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e28a08c2-52fb-4832-8264-6bd37af93eb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:31.172394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:31.214964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a08c2-52fb-4832-8264-6bd37af93eb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:31.216432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28a08c2-52fb-4832-8264-6bd37af93eb3 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:31.235204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 662/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:33.499016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712a867-a5a6-456a-81f8-8cb7c6a9002b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:33.499619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712a867-a5a6-456a-81f8-8cb7c6a9002b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:33.499619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712a867-a5a6-456a-81f8-8cb7c6a9002b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:33.501021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 664/1326] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:33.507315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14df33-d842-4b7e-839a-51883c4a174a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:33.507880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14df33-d842-4b7e-839a-51883c4a174a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:33.507880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14df33-d842-4b7e-839a-51883c4a174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:33.578180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ad14df33-d842-4b7e-839a-51883c4a174a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:33.579398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ad14df33-d842-4b7e-839a-51883c4a174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:33.678255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 663/1327] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:22:33.714110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712a867-a5a6-456a-81f8-8cb7c6a9002b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:33.715649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9712a867-a5a6-456a-81f8-8cb7c6a9002b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:33.780970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:33.823615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712a867-a5a6-456a-81f8-8cb7c6a9002b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:33.901959 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4002-bb61-4c2b-8b54-07d5e971d5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:33.902607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4002-bb61-4c2b-8b54-07d5e971d5da service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:33.902885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4002-bb61-4c2b-8b54-07d5e971d5da service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:33.903152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4002-bb61-4c2b-8b54-07d5e971d5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:33.904801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e6af4002-bb61-4c2b-8b54-07d5e971d5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:34.017068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:34.019532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af4002-bb61-4c2b-8b54-07d5e971d5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:34.021070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af4002-bb61-4c2b-8b54-07d5e971d5da service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:34.040298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 665/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:36.103641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bc992-f1e3-42bf-bbff-300666fbae67 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:36.104168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bc992-f1e3-42bf-bbff-300666fbae67 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:36.104168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553bc992-f1e3-42bf-bbff-300666fbae67 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:36.105602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 664/1329] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:36.111162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba8e8-3acf-4af8-9a2b-057ac1588815 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:36.111602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba8e8-3acf-4af8-9a2b-057ac1588815 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:36.111704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dba8e8-3acf-4af8-9a2b-057ac1588815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:36.175731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-08dba8e8-3acf-4af8-9a2b-057ac1588815 None None] MFA Rules not processed for user `b6c16790bfc747a1a44c51bfa8616856`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:36.176955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-08dba8e8-3acf-4af8-9a2b-057ac1588815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:36.290424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 666/1330] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:36.326765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bc992-f1e3-42bf-bbff-300666fbae67 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:36.328317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-553bc992-f1e3-42bf-bbff-300666fbae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:36.363064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:36.440653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553bc992-f1e3-42bf-bbff-300666fbae67 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:36.522962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0d8dc-2c8f-4d48-ab68-e76229705631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:36.523534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0d8dc-2c8f-4d48-ab68-e76229705631 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:36.523845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0d8dc-2c8f-4d48-ab68-e76229705631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:36.524132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0d8dc-2c8f-4d48-ab68-e76229705631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:36.525823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d0b0d8dc-2c8f-4d48-ab68-e76229705631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:36.619289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:36.657944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0d8dc-2c8f-4d48-ab68-e76229705631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:36.659402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0d8dc-2c8f-4d48-ab68-e76229705631 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:36.686576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 665/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:36 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:39.107888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0a1b1-46f2-486f-b34e-07bd4b0819e5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:39.108540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0a1b1-46f2-486f-b34e-07bd4b0819e5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:39.108540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0a1b1-46f2-486f-b34e-07bd4b0819e5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:39.109867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 667/1332] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:39.116087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b90ea-cfb8-434a-ad77-6eb3f75f05dc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:39.116825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b90ea-cfb8-434a-ad77-6eb3f75f05dc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:39.117042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b90ea-cfb8-434a-ad77-6eb3f75f05dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:39.191599 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f81b90ea-cfb8-434a-ad77-6eb3f75f05dc None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:39.192807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f81b90ea-cfb8-434a-ad77-6eb3f75f05dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:39.323257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 666/1333] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:39.362990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0a1b1-46f2-486f-b34e-07bd4b0819e5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:39.365416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f1f0a1b1-46f2-486f-b34e-07bd4b0819e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:39.444715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:39.484285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0a1b1-46f2-486f-b34e-07bd4b0819e5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:39.568457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb53b-bdbb-4372-9924-781386a7d254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:39.569193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb53b-bdbb-4372-9924-781386a7d254 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:39.569474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb53b-bdbb-4372-9924-781386a7d254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:39.569751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb53b-bdbb-4372-9924-781386a7d254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:39.571409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-873eb53b-bdbb-4372-9924-781386a7d254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:39.692436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb53b-bdbb-4372-9924-781386a7d254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:39.693867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb53b-bdbb-4372-9924-781386a7d254 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:39.703964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:39.713757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 668/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:41.770153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4089f-7410-4289-bdab-51673e9498f4 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:41.770742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4089f-7410-4289-bdab-51673e9498f4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:41.770742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4089f-7410-4289-bdab-51673e9498f4 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:41.772336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 667/1335] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:41.777604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd956f4-e93e-41e9-a8e4-8ab9bd75b143 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:41.778037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd956f4-e93e-41e9-a8e4-8ab9bd75b143 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:41.778161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd956f4-e93e-41e9-a8e4-8ab9bd75b143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:41.846816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2bd956f4-e93e-41e9-a8e4-8ab9bd75b143 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:41.848028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2bd956f4-e93e-41e9-a8e4-8ab9bd75b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:41.959833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 669/1336] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:42.003082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4089f-7410-4289-bdab-51673e9498f4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:42.005577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-39a4089f-7410-4289-bdab-51673e9498f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:42.053818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:42.121819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4089f-7410-4289-bdab-51673e9498f4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:42.198820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efba2d8-3331-40a7-a586-4c48584402c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:42.199467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efba2d8-3331-40a7-a586-4c48584402c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:42.199742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efba2d8-3331-40a7-a586-4c48584402c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:42.200013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efba2d8-3331-40a7-a586-4c48584402c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:42.201690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0efba2d8-3331-40a7-a586-4c48584402c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:42.286470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:42.313576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efba2d8-3331-40a7-a586-4c48584402c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:42.315029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efba2d8-3331-40a7-a586-4c48584402c9 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:42.333603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 668/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:44.824926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215198c-d6ae-46e2-8a37-777c84684049 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:44.825505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215198c-d6ae-46e2-8a37-777c84684049 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:44.825505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215198c-d6ae-46e2-8a37-777c84684049 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:44.826894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 670/1338] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:44.832525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da4e9-9e09-457b-a98e-908143457bf2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:44.832967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da4e9-9e09-457b-a98e-908143457bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:44.833083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0da4e9-9e09-457b-a98e-908143457bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:44.906794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6c0da4e9-9e09-457b-a98e-908143457bf2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:44.908023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6c0da4e9-9e09-457b-a98e-908143457bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:45.015828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 669/1339] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:45.055344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215198c-d6ae-46e2-8a37-777c84684049 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:45.057068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f215198c-d6ae-46e2-8a37-777c84684049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:45.142422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:45.171036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215198c-d6ae-46e2-8a37-777c84684049 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:45.252530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67aa3e5-3d00-4070-81c2-c7052ad27181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:45.253222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa3e5-3d00-4070-81c2-c7052ad27181 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:45.253499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa3e5-3d00-4070-81c2-c7052ad27181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:45.253751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67aa3e5-3d00-4070-81c2-c7052ad27181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:45.255393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b67aa3e5-3d00-4070-81c2-c7052ad27181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:45.375629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aa3e5-3d00-4070-81c2-c7052ad27181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:45.377106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67aa3e5-3d00-4070-81c2-c7052ad27181 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:45.395915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 671/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:49.506500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781d15-2287-4306-990a-fe48d44ed385 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:49.507029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781d15-2287-4306-990a-fe48d44ed385 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:49.507125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33781d15-2287-4306-990a-fe48d44ed385 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:49.508531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 670/1341] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:49.514730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6956d-d39c-4f4a-ba77-0927de522bfe None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:49.515263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6956d-d39c-4f4a-ba77-0927de522bfe None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:49.515394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6956d-d39c-4f4a-ba77-0927de522bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:49.522154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:49.594385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7be6956d-d39c-4f4a-ba77-0927de522bfe None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:49.595614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7be6956d-d39c-4f4a-ba77-0927de522bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:49.702753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 672/1342] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:49.745322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781d15-2287-4306-990a-fe48d44ed385 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:49.747812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-33781d15-2287-4306-990a-fe48d44ed385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:49.801578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:22:49.849503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33781d15-2287-4306-990a-fe48d44ed385 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:49.853274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb969e8d-112b-4efa-a9dd-e0003dc28a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:49.853940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb969e8d-112b-4efa-a9dd-e0003dc28a42 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:49.854239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb969e8d-112b-4efa-a9dd-e0003dc28a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:49.854497 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb969e8d-112b-4efa-a9dd-e0003dc28a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:49.864639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb969e8d-112b-4efa-a9dd-e0003dc28a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:49.866228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb969e8d-112b-4efa-a9dd-e0003dc28a42 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:49.876000 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 671/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:52.505762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66a0d-ee14-4db9-b3a6-7453b44d33a6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:52.506359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66a0d-ee14-4db9-b3a6-7453b44d33a6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:52.506359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66a0d-ee14-4db9-b3a6-7453b44d33a6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:52.507672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 673/1344] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:52.513440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3165d-5fce-40ac-aea7-b13d673205e8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:52.514074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3165d-5fce-40ac-aea7-b13d673205e8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:52.514074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3165d-5fce-40ac-aea7-b13d673205e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:52.543357 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cff3165d-5fce-40ac-aea7-b13d673205e8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:52.544562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cff3165d-5fce-40ac-aea7-b13d673205e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:52.631311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 672/1345] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:52.669390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66a0d-ee14-4db9-b3a6-7453b44d33a6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:52.681489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66a0d-ee14-4db9-b3a6-7453b44d33a6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:52.685372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73779ccc-d2b4-446e-b2ff-fd92710dc2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:52.686046 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73779ccc-d2b4-446e-b2ff-fd92710dc2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:52.686323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73779ccc-d2b4-446e-b2ff-fd92710dc2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:52.686594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73779ccc-d2b4-446e-b2ff-fd92710dc2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:52.696669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73779ccc-d2b4-446e-b2ff-fd92710dc2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:52.698208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73779ccc-d2b4-446e-b2ff-fd92710dc2f4 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:52.708810 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 674/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:22:56.667559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d705d-58b4-443f-bf8e-1632f77d2663 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:56.668146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d705d-58b4-443f-bf8e-1632f77d2663 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:56.668146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d705d-58b4-443f-bf8e-1632f77d2663 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:56.669688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 673/1347] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:22:56.675783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51347e41-bd7e-4d36-bc40-4a0c44f9cc05 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:56.676291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51347e41-bd7e-4d36-bc40-4a0c44f9cc05 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:56.676291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51347e41-bd7e-4d36-bc40-4a0c44f9cc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:56.694763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-51347e41-bd7e-4d36-bc40-4a0c44f9cc05 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:22:56.695995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-51347e41-bd7e-4d36-bc40-4a0c44f9cc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:56.704938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 675/1348] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:22:56.743752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d705d-58b4-443f-bf8e-1632f77d2663 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:22:56.752117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-112d705d-58b4-443f-bf8e-1632f77d2663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:22:56.766986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d705d-58b4-443f-bf8e-1632f77d2663 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:22:56.770827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653dad8-c7b2-4deb-a03f-62efae39578f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:22:56.771476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653dad8-c7b2-4deb-a03f-62efae39578f service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:22:56.771755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653dad8-c7b2-4deb-a03f-62efae39578f service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:22:56.772026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653dad8-c7b2-4deb-a03f-62efae39578f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:22:56.781504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653dad8-c7b2-4deb-a03f-62efae39578f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:22:56.782962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653dad8-c7b2-4deb-a03f-62efae39578f service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:22:56.792433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 674/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:01.758690 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8556e8c-b984-46bc-b080-693b67db782e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:01.759500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8556e8c-b984-46bc-b080-693b67db782e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:01.759903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8556e8c-b984-46bc-b080-693b67db782e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:01.761807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 676/1350] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:01.778511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999a342-aca9-4084-af9a-9432219b0d94 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:01.778987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999a342-aca9-4084-af9a-9432219b0d94 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:01.779083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999a342-aca9-4084-af9a-9432219b0d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:01.896100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6999a342-aca9-4084-af9a-9432219b0d94 None None] MFA Rules not processed for user `eb3ded7163fa400399d1b09079a366ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:01.897334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6999a342-aca9-4084-af9a-9432219b0d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:01.924669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:23:01.978018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 675/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:23:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:06.076712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f21a3-9922-4c2e-b5d7-0ed8f55756a8 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:06.077664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f21a3-9922-4c2e-b5d7-0ed8f55756a8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:06.077902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f21a3-9922-4c2e-b5d7-0ed8f55756a8 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:06.079466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 677/1352] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:06.084811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a561c0-2b9c-409b-98a6-580ae72554d8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:06.085375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a561c0-2b9c-409b-98a6-580ae72554d8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:06.085624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a561c0-2b9c-409b-98a6-580ae72554d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:06.104877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a9a561c0-2b9c-409b-98a6-580ae72554d8 None None] MFA Rules not processed for user `eb3ded7163fa400399d1b09079a366ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:06.106088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a9a561c0-2b9c-409b-98a6-580ae72554d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:06.114822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 676/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:23:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:06.693547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=72 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:23:07.549119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89cc4-ed8a-4073-90c9-ff2613926f20 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:07.549838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89cc4-ed8a-4073-90c9-ff2613926f20 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:07.549838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c89cc4-ed8a-4073-90c9-ff2613926f20 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:07.550982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 678/1354] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:07.556046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816c181-7123-4543-b0a9-19154481960a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:07.556469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816c181-7123-4543-b0a9-19154481960a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:07.556747 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816c181-7123-4543-b0a9-19154481960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:07.577991 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e816c181-7123-4543-b0a9-19154481960a None None] MFA Rules not processed for user `eb3ded7163fa400399d1b09079a366ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:07.579311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e816c181-7123-4543-b0a9-19154481960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:07.589255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 677/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:23:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:23:11.260831 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d277bd-398d-40cd-a188-11f9a103b3e5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:11.261762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d277bd-398d-40cd-a188-11f9a103b3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:11.262194 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d277bd-398d-40cd-a188-11f9a103b3e5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:11.268018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 679/1356] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:11.269766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfc24-a142-41d6-9774-44459d523e20 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:11.270650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfc24-a142-41d6-9774-44459d523e20 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:11.271163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dfc24-a142-41d6-9774-44459d523e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:11.296976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a97dfc24-a142-41d6-9774-44459d523e20 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:11.298576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a97dfc24-a142-41d6-9774-44459d523e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:11.307382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 678/1357] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:11.367773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5e21-f9f7-49c3-9eb6-5490d1c1f2e8 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:11.368399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5e21-f9f7-49c3-9eb6-5490d1c1f2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:11.369060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5e21-f9f7-49c3-9eb6-5490d1c1f2e8 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:11.371051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 680/1358] 10.222.0.59 () {54 vars in 961 bytes} [Fri Jul 1 16:23:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:11.382788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8b1b-6845-4424-9834-8c57996fe2e2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:11.383493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8b1b-6845-4424-9834-8c57996fe2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:11.383986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb8b1b-6845-4424-9834-8c57996fe2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:11.435841 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-08eb8b1b-6845-4424-9834-8c57996fe2e2 None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:11.437039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-08eb8b1b-6845-4424-9834-8c57996fe2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:11.523756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 679/1359] 10.222.0.59 () {58 vars in 1058 bytes} [Fri Jul 1 16:23:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:11.532862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a5e21-f9f7-49c3-9eb6-5490d1c1f2e8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:11.547838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a5e21-f9f7-49c3-9eb6-5490d1c1f2e8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:11.553682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d15dc-f1d6-45b7-9e55-dab47fd738c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:11.554561 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d15dc-f1d6-45b7-9e55-dab47fd738c6 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:11.555014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d15dc-f1d6-45b7-9e55-dab47fd738c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:11.555451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d15dc-f1d6-45b7-9e55-dab47fd738c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:11.567468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d15dc-f1d6-45b7-9e55-dab47fd738c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:11.569415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d15dc-f1d6-45b7-9e55-dab47fd738c6 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:11.581844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 681/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:13.798057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8337647-7106-43c5-afb1-ed906c517f04 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:13.798650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8337647-7106-43c5-afb1-ed906c517f04 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:13.798650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8337647-7106-43c5-afb1-ed906c517f04 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:13.800172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 680/1361] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:13.805270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb7ee1-9b58-42e0-a7f1-864bd9d3fb0f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:13.805723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb7ee1-9b58-42e0-a7f1-864bd9d3fb0f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:13.805832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb7ee1-9b58-42e0-a7f1-864bd9d3fb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:13.824321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9ddb7ee1-9b58-42e0-a7f1-864bd9d3fb0f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:13.825869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9ddb7ee1-9b58-42e0-a7f1-864bd9d3fb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:13.833947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 682/1362] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:13.879388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8337647-7106-43c5-afb1-ed906c517f04 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:13.894618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8337647-7106-43c5-afb1-ed906c517f04 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:13.900206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591be42c-f67f-4fbd-bca0-d68a23f46d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:13.900870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be42c-f67f-4fbd-bca0-d68a23f46d56 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:13.901153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be42c-f67f-4fbd-bca0-d68a23f46d56 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:13.901425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591be42c-f67f-4fbd-bca0-d68a23f46d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:13.910450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591be42c-f67f-4fbd-bca0-d68a23f46d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:13.912148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591be42c-f67f-4fbd-bca0-d68a23f46d56 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:13.922189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 681/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:16.268118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353a16-b03c-401d-ae45-e870775125d5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:16.268830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353a16-b03c-401d-ae45-e870775125d5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:16.268830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d353a16-b03c-401d-ae45-e870775125d5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:16.270530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 683/1364] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:16.275628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3687b8-3833-4ab5-ad28-7941f88cabde None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:16.276087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3687b8-3833-4ab5-ad28-7941f88cabde None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:16.276170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3687b8-3833-4ab5-ad28-7941f88cabde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:16.296169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ab3687b8-3833-4ab5-ad28-7941f88cabde None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:16.297432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ab3687b8-3833-4ab5-ad28-7941f88cabde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:16.307233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 682/1365] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:16.355132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad8d1e-cadf-4584-89da-c3b8400127c8 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:16.355453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad8d1e-cadf-4584-89da-c3b8400127c8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:16.355703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad8d1e-cadf-4584-89da-c3b8400127c8 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:16.357173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 684/1366] 10.222.0.59 () {54 vars in 961 bytes} [Fri Jul 1 16:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:16.363110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787841a9-3d7b-42b9-b91a-00171474f212 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:16.363364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787841a9-3d7b-42b9-b91a-00171474f212 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:16.363678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787841a9-3d7b-42b9-b91a-00171474f212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:16.382358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-787841a9-3d7b-42b9-b91a-00171474f212 None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:16.383590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-787841a9-3d7b-42b9-b91a-00171474f212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:16.393310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 683/1367] 10.222.0.59 () {58 vars in 1058 bytes} [Fri Jul 1 16:23:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:16.401587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad8d1e-cadf-4584-89da-c3b8400127c8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:16.416794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad8d1e-cadf-4584-89da-c3b8400127c8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:16.422308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98eca07-9b08-4d43-9385-d8bd493396c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:16.422950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eca07-9b08-4d43-9385-d8bd493396c0 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:16.423229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eca07-9b08-4d43-9385-d8bd493396c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:16.423502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98eca07-9b08-4d43-9385-d8bd493396c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:16.431909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98eca07-9b08-4d43-9385-d8bd493396c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:16.434206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98eca07-9b08-4d43-9385-d8bd493396c0 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:16.445036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 685/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:18.531782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b3f83-510e-4c61-aa4a-1d4723b40efd None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:18.532352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b3f83-510e-4c61-aa4a-1d4723b40efd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:18.532352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b3f83-510e-4c61-aa4a-1d4723b40efd None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:18.533721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 684/1369] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:18.539258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208af35e-27dc-4688-8600-d3f213042a4d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:18.539991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208af35e-27dc-4688-8600-d3f213042a4d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:18.540427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208af35e-27dc-4688-8600-d3f213042a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:18.558714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-208af35e-27dc-4688-8600-d3f213042a4d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:18.560125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-208af35e-27dc-4688-8600-d3f213042a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:18.569255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 686/1370] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:18.612745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b3f83-510e-4c61-aa4a-1d4723b40efd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:18.632887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b3f83-510e-4c61-aa4a-1d4723b40efd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:18.639397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1114ca1-a269-4e72-95c6-b9f264ebb446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:18.640087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1114ca1-a269-4e72-95c6-b9f264ebb446 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:18.640371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1114ca1-a269-4e72-95c6-b9f264ebb446 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:18.640649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1114ca1-a269-4e72-95c6-b9f264ebb446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:18.650863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1114ca1-a269-4e72-95c6-b9f264ebb446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:18.652871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1114ca1-a269-4e72-95c6-b9f264ebb446 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:18.664325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 685/1371] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:19.308614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fd2c-fe46-45f2-b78c-0d69e34a611c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:19.309220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fd2c-fe46-45f2-b78c-0d69e34a611c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:19.309467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3fd2c-fe46-45f2-b78c-0d69e34a611c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:19.311021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 687/1372] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:19.316404 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03977591-74fb-4c9a-a277-472d658c2628 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:19.316673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03977591-74fb-4c9a-a277-472d658c2628 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:19.317008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03977591-74fb-4c9a-a277-472d658c2628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:19.336101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-03977591-74fb-4c9a-a277-472d658c2628 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:19.337366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-03977591-74fb-4c9a-a277-472d658c2628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:19.346356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 686/1373] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:19.685826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf791-7c19-4b04-b79e-c42a3d2f5d6a None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:19.685826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf791-7c19-4b04-b79e-c42a3d2f5d6a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:19.685826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acaf791-7c19-4b04-b79e-c42a3d2f5d6a None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:19.687143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 688/1374] 10.222.0.59 () {54 vars in 963 bytes} [Fri Jul 1 16:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:19.691680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ba848-c397-4765-a7c6-38f9e32a8692 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:19.692184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ba848-c397-4765-a7c6-38f9e32a8692 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:19.692184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ba848-c397-4765-a7c6-38f9e32a8692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:19.699034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:23:19.742880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d04ba848-c397-4765-a7c6-38f9e32a8692 None None] MFA Rules not processed for user `c4980d7e51e84655add2a53808818598`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:19.744071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d04ba848-c397-4765-a7c6-38f9e32a8692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:19.805844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 687/1375] 10.222.0.59 () {58 vars in 1060 bytes} [Fri Jul 1 16:23:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:19.813725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaf791-7c19-4b04-b79e-c42a3d2f5d6a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:19.825844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acaf791-7c19-4b04-b79e-c42a3d2f5d6a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:19.829519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad0ca9-2e9f-44ba-a5c7-76524f9f8874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:19.830323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0ca9-2e9f-44ba-a5c7-76524f9f8874 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:19.830608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0ca9-2e9f-44ba-a5c7-76524f9f8874 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:19.830884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0ca9-2e9f-44ba-a5c7-76524f9f8874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:19.841893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad0ca9-2e9f-44ba-a5c7-76524f9f8874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:19.843368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad0ca9-2e9f-44ba-a5c7-76524f9f8874 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:19.854532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 689/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:20.754001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafcd1a-89ca-4287-a41d-7a7410a46749 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:20.754511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafcd1a-89ca-4287-a41d-7a7410a46749 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:20.754607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafcd1a-89ca-4287-a41d-7a7410a46749 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:20.755983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 688/1377] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:20.761490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32df736-f1c3-42ae-aed4-23abe1da9056 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:20.761924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32df736-f1c3-42ae-aed4-23abe1da9056 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:20.762036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32df736-f1c3-42ae-aed4-23abe1da9056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:20.779708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c32df736-f1c3-42ae-aed4-23abe1da9056 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:20.780903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c32df736-f1c3-42ae-aed4-23abe1da9056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:20.789107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 690/1378] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:20.832561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafcd1a-89ca-4287-a41d-7a7410a46749 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:20.848064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafcd1a-89ca-4287-a41d-7a7410a46749 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:20.854082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdaaac-c935-4927-8c3b-5c5319435388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:20.854723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdaaac-c935-4927-8c3b-5c5319435388 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:20.855006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdaaac-c935-4927-8c3b-5c5319435388 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:20.855284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdaaac-c935-4927-8c3b-5c5319435388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:20.863658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdaaac-c935-4927-8c3b-5c5319435388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:20.865297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdaaac-c935-4927-8c3b-5c5319435388 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:20.874955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 689/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:22.931505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb993fc0-ac69-42dc-bfe0-58f57be3a0d3 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:22.932456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb993fc0-ac69-42dc-bfe0-58f57be3a0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:22.932701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb993fc0-ac69-42dc-bfe0-58f57be3a0d3 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:22.934326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 691/1380] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:22.940257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a372-9202-46a7-a373-b1cf5378fd85 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:22.940696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a372-9202-46a7-a373-b1cf5378fd85 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:22.940786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910a372-9202-46a7-a373-b1cf5378fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:22.959449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b910a372-9202-46a7-a373-b1cf5378fd85 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:22.960696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b910a372-9202-46a7-a373-b1cf5378fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:22.968974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 690/1381] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:23.012616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb993fc0-ac69-42dc-bfe0-58f57be3a0d3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:23.027185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb993fc0-ac69-42dc-bfe0-58f57be3a0d3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:23.033108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd1ffe-1c71-4ad8-babe-238b4852a8ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:23.033948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd1ffe-1c71-4ad8-babe-238b4852a8ef service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:23.034232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd1ffe-1c71-4ad8-babe-238b4852a8ef service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:23.034545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd1ffe-1c71-4ad8-babe-238b4852a8ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:23.042846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd1ffe-1c71-4ad8-babe-238b4852a8ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:23.044456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd1ffe-1c71-4ad8-babe-238b4852a8ef service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:23.053943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 692/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:25.113222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc420ce-1aa7-4602-9402-fbd295e96542 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:25.113779 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc420ce-1aa7-4602-9402-fbd295e96542 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:25.113779 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc420ce-1aa7-4602-9402-fbd295e96542 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:25.115403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 691/1383] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:25.120749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cae0f6-c828-43c1-b7a6-3cc1d84771a9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:25.121276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cae0f6-c828-43c1-b7a6-3cc1d84771a9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:25.121379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cae0f6-c828-43c1-b7a6-3cc1d84771a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:25.140346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a1cae0f6-c828-43c1-b7a6-3cc1d84771a9 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:25.141584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a1cae0f6-c828-43c1-b7a6-3cc1d84771a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:25.150541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 693/1384] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:25.191473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc420ce-1aa7-4602-9402-fbd295e96542 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:25.207680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc420ce-1aa7-4602-9402-fbd295e96542 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:25.214517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d528471-1eed-49ef-a3d1-73f0ba372964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:25.215175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d528471-1eed-49ef-a3d1-73f0ba372964 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:25.215485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d528471-1eed-49ef-a3d1-73f0ba372964 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:25.215764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d528471-1eed-49ef-a3d1-73f0ba372964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:25.225560 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d528471-1eed-49ef-a3d1-73f0ba372964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:25.227183 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d528471-1eed-49ef-a3d1-73f0ba372964 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:25.238526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 692/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:27.279721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1134ca-9d88-45bf-8b5d-9f8c750626de None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:27.280474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1134ca-9d88-45bf-8b5d-9f8c750626de None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:27.280474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1134ca-9d88-45bf-8b5d-9f8c750626de None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:27.281826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 694/1386] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:27.287116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ab0ec-0f55-4234-be99-7ed9b8598bde None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:27.287591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ab0ec-0f55-4234-be99-7ed9b8598bde None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:27.287784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ab0ec-0f55-4234-be99-7ed9b8598bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:27.311272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5e4ab0ec-0f55-4234-be99-7ed9b8598bde None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:27.312502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5e4ab0ec-0f55-4234-be99-7ed9b8598bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:27.320617 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 693/1387] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:27.366378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1134ca-9d88-45bf-8b5d-9f8c750626de None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:27.381026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1134ca-9d88-45bf-8b5d-9f8c750626de None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:27.386662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d539d0d5-c21a-41aa-b49b-f52d4a05f45e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:27.387324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539d0d5-c21a-41aa-b49b-f52d4a05f45e service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:27.387604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539d0d5-c21a-41aa-b49b-f52d4a05f45e service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:27.387878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d539d0d5-c21a-41aa-b49b-f52d4a05f45e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:27.397284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539d0d5-c21a-41aa-b49b-f52d4a05f45e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:27.398936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d539d0d5-c21a-41aa-b49b-f52d4a05f45e service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:27.408683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 695/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:29.455005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c87f2-9ba6-4638-8471-d9d2be765be6 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:29.455820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c87f2-9ba6-4638-8471-d9d2be765be6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:29.455820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c87f2-9ba6-4638-8471-d9d2be765be6 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:29.457010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 694/1389] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:29.463364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5e3f5-9000-4669-bb32-fdc201ec48de None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:29.463829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5e3f5-9000-4669-bb32-fdc201ec48de None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:29.464356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5e3f5-9000-4669-bb32-fdc201ec48de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:29.488817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0df5e3f5-9000-4669-bb32-fdc201ec48de None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:29.490190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0df5e3f5-9000-4669-bb32-fdc201ec48de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:29.499890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 696/1390] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:29.544105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c87f2-9ba6-4638-8471-d9d2be765be6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:29.559693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c87f2-9ba6-4638-8471-d9d2be765be6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:29.565373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc377460-1599-4d84-953f-4f28af51e441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:29.566057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377460-1599-4d84-953f-4f28af51e441 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:29.566354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377460-1599-4d84-953f-4f28af51e441 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:29.566649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc377460-1599-4d84-953f-4f28af51e441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:29.575816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc377460-1599-4d84-953f-4f28af51e441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:29.577553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc377460-1599-4d84-953f-4f28af51e441 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:29.587826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 695/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:31.672301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce48a-d86c-4844-8d79-354399b2d5fe None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:31.672910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce48a-d86c-4844-8d79-354399b2d5fe None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:31.672910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ce48a-d86c-4844-8d79-354399b2d5fe None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:31.674255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 697/1392] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:31.680009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f666b-9b64-41d6-9c84-d4d107c6793b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:31.680769 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f666b-9b64-41d6-9c84-d4d107c6793b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:31.680769 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f666b-9b64-41d6-9c84-d4d107c6793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:31.699465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3d6f666b-9b64-41d6-9c84-d4d107c6793b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:31.700685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3d6f666b-9b64-41d6-9c84-d4d107c6793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:31.709141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 696/1393] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:31.759728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce48a-d86c-4844-8d79-354399b2d5fe None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:31.785528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ce48a-d86c-4844-8d79-354399b2d5fe None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:31.798185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4413ce-f4c1-45ba-b092-3fd0527a162d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:31.800087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4413ce-f4c1-45ba-b092-3fd0527a162d service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:31.800809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4413ce-f4c1-45ba-b092-3fd0527a162d service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:31.805741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4413ce-f4c1-45ba-b092-3fd0527a162d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:31.823947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4413ce-f4c1-45ba-b092-3fd0527a162d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:31.826318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4413ce-f4c1-45ba-b092-3fd0527a162d service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:31.839558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 698/1394] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:33.932650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7855-f167-435e-a246-c00c4a2774bb None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:33.933279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7855-f167-435e-a246-c00c4a2774bb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:33.933279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd7855-f167-435e-a246-c00c4a2774bb None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:33.934628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 697/1395] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:33.939996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b0b4a-8675-4cc8-b7fb-e1e2498c195e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:33.940452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b0b4a-8675-4cc8-b7fb-e1e2498c195e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:33.940559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b0b4a-8675-4cc8-b7fb-e1e2498c195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:33.959423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ca4b0b4a-8675-4cc8-b7fb-e1e2498c195e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:33.960649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ca4b0b4a-8675-4cc8-b7fb-e1e2498c195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:33.969966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 699/1396] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:34.014822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd7855-f167-435e-a246-c00c4a2774bb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:34.031342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd7855-f167-435e-a246-c00c4a2774bb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:34.036753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e54a5b-d38e-4df6-bd26-23caff3a2852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:34.037454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54a5b-d38e-4df6-bd26-23caff3a2852 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:34.037735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54a5b-d38e-4df6-bd26-23caff3a2852 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:34.038083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54a5b-d38e-4df6-bd26-23caff3a2852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:34.047418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e54a5b-d38e-4df6-bd26-23caff3a2852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:34.049095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e54a5b-d38e-4df6-bd26-23caff3a2852 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:34.059023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 698/1397] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:34.951504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0d56-4a2e-4bad-9b58-e4e97dcdc528 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:34.952153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0d56-4a2e-4bad-9b58-e4e97dcdc528 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:34.952153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e0d56-4a2e-4bad-9b58-e4e97dcdc528 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:34.953514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 700/1398] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:34.958847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52124c74-5084-42c8-8058-eecde41b8b4d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:34.959313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52124c74-5084-42c8-8058-eecde41b8b4d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:34.959407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52124c74-5084-42c8-8058-eecde41b8b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:34.977949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-52124c74-5084-42c8-8058-eecde41b8b4d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:34.979158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-52124c74-5084-42c8-8058-eecde41b8b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:34.988276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 699/1399] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:35.046878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fee800-5b60-44d4-b416-b1e3209c6abf None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:35.047197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fee800-5b60-44d4-b416-b1e3209c6abf None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:35.047466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fee800-5b60-44d4-b416-b1e3209c6abf None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:35.048875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 701/1400] 10.222.0.59 () {54 vars in 962 bytes} [Fri Jul 1 16:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:35.054293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e6fd-7af8-4ef7-b53d-bc289caaf47f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:35.054580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e6fd-7af8-4ef7-b53d-bc289caaf47f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:35.054853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2e6fd-7af8-4ef7-b53d-bc289caaf47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:35.106333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e0a2e6fd-7af8-4ef7-b53d-bc289caaf47f None None] MFA Rules not processed for user `87a4ed0881004eef94166ace450b8a63`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:35.107534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e0a2e6fd-7af8-4ef7-b53d-bc289caaf47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:35.143014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:23:35.173911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 700/1401] 10.222.0.59 () {58 vars in 1059 bytes} [Fri Jul 1 16:23:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:35.181517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fee800-5b60-44d4-b416-b1e3209c6abf None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:35.192374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fee800-5b60-44d4-b416-b1e3209c6abf None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:35.196431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9606ae-5744-4f95-8636-c60dfe4563cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a4ed0881004eef94166ace450b8a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:35.197150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9606ae-5744-4f95-8636-c60dfe4563cb service glance] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:35.197428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9606ae-5744-4f95-8636-c60dfe4563cb service glance] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:35.197701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9606ae-5744-4f95-8636-c60dfe4563cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:35.208089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9606ae-5744-4f95-8636-c60dfe4563cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:35.209991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9606ae-5744-4f95-8636-c60dfe4563cb service glance] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:35.220974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 702/1402] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:23:35.937192 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4d2d2-5a18-46a1-9a87-868867dd7a8e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:35.937499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4d2d2-5a18-46a1-9a87-868867dd7a8e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:35.937779 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4d2d2-5a18-46a1-9a87-868867dd7a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:35.988899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-74a4d2d2-5a18-46a1-9a87-868867dd7a8e None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:35.990118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-74a4d2d2-5a18-46a1-9a87-868867dd7a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:36.054929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 701/1403] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:23:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:36.095557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf31224-c961-4e9a-91ef-f81c5d5f23e6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:36.096076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf31224-c961-4e9a-91ef-f81c5d5f23e6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:36.096259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf31224-c961-4e9a-91ef-f81c5d5f23e6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:36.097761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 703/1404] 10.222.0.59 () {54 vars in 942 bytes} [Fri Jul 1 16:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:36.104432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010a9e-1a48-437c-a873-23760af7c72e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:36.104719 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010a9e-1a48-437c-a873-23760af7c72e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:36.105038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab010a9e-1a48-437c-a873-23760af7c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:36.134537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e57e8-8bc1-4a93-bd2e-46ce93fc5153 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:36.135089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e57e8-8bc1-4a93-bd2e-46ce93fc5153 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:36.135329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e57e8-8bc1-4a93-bd2e-46ce93fc5153 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:36.136786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 704/1405] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:23:36.142067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369139d-53f5-475d-8595-24cf9d4cb1aa None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:36.142346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369139d-53f5-475d-8595-24cf9d4cb1aa None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:36.142646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369139d-53f5-475d-8595-24cf9d4cb1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:36.159687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ab010a9e-1a48-437c-a873-23760af7c72e None None] MFA Rules not processed for user `7db0ec167b464cfea43931cd3c6183e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:36.160943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ab010a9e-1a48-437c-a873-23760af7c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:36.161233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1369139d-53f5-475d-8595-24cf9d4cb1aa None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:36.162445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1369139d-53f5-475d-8595-24cf9d4cb1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:36.171137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 705/1406] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:23:36.215269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369139d-53f5-475d-8595-24cf9d4cb1aa None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:36.228261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369139d-53f5-475d-8595-24cf9d4cb1aa None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:36.233591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 702/1407] 10.222.0.59 () {58 vars in 1039 bytes} [Fri Jul 1 16:23:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:36.234674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a3210-98d3-4907-ba9a-2ee276a3a071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:36.235527 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a3210-98d3-4907-ba9a-2ee276a3a071 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:36.235800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a3210-98d3-4907-ba9a-2ee276a3a071 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:36.236071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a3210-98d3-4907-ba9a-2ee276a3a071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:36.242834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab010a9e-1a48-437c-a873-23760af7c72e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:23:36.245492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a3210-98d3-4907-ba9a-2ee276a3a071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:36.247098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a3210-98d3-4907-ba9a-2ee276a3a071 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:36.252273 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab010a9e-1a48-437c-a873-23760af7c72e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:23:36.256504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 706/1408] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:23:36.257357 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51752df-839f-4b83-9aeb-8c4c6dae6618 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:23:36.257998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51752df-839f-4b83-9aeb-8c4c6dae6618 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:36.258271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51752df-839f-4b83-9aeb-8c4c6dae6618 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:36.258545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51752df-839f-4b83-9aeb-8c4c6dae6618 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:36.266827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51752df-839f-4b83-9aeb-8c4c6dae6618 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:23:36.268424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51752df-839f-4b83-9aeb-8c4c6dae6618 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:23:36.273315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:23:36.278736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 703/1409] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:23:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 16:23:46.252424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=69 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:23:58.117375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac176-422e-47b7-a89b-43a49d4b4779 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:58.118086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac176-422e-47b7-a89b-43a49d4b4779 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:58.118086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac176-422e-47b7-a89b-43a49d4b4779 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:58.119337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 707/1410] 10.222.0.59 () {54 vars in 918 bytes} [Fri Jul 1 16:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:58.126671 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951db48-3277-405d-9dc0-f546cbcc9ec6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:58.127122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951db48-3277-405d-9dc0-f546cbcc9ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:58.127238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951db48-3277-405d-9dc0-f546cbcc9ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:58.152724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1951db48-3277-405d-9dc0-f546cbcc9ec6 None None] MFA Rules not processed for user `eb3ded7163fa400399d1b09079a366ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:58.154968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1951db48-3277-405d-9dc0-f546cbcc9ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:58.167080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 704/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jul 1 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:23:58.181251 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf379a2-466a-4c29-bb26-67e7247fe862 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:58.181539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf379a2-466a-4c29-bb26-67e7247fe862 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:58.181847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf379a2-466a-4c29-bb26-67e7247fe862 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:58.183239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 708/1412] 10.222.0.59 () {54 vars in 918 bytes} [Fri Jul 1 16:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:23:58.187947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655d3c-449e-400b-b4a3-823d1be8f015 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:23:58.188240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655d3c-449e-400b-b4a3-823d1be8f015 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:23:58.188513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc655d3c-449e-400b-b4a3-823d1be8f015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:23:58.207743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cc655d3c-449e-400b-b4a3-823d1be8f015 None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:23:58.208972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cc655d3c-449e-400b-b4a3-823d1be8f015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:23:58.219637 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 705/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Fri Jul 1 16:23:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:00.760648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ffa7-c67c-48e2-9de0-cf3bbbbd3fc4 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:00.761203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ffa7-c67c-48e2-9de0-cf3bbbbd3fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:00.761203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ffa7-c67c-48e2-9de0-cf3bbbbd3fc4 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:00.763419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:00.771929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c6840-3f67-47e7-91ae-485494fccbf6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:00.772375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c6840-3f67-47e7-91ae-485494fccbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:00.772558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c6840-3f67-47e7-91ae-485494fccbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:00.792092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a89c6840-3f67-47e7-91ae-485494fccbf6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:00.793331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a89c6840-3f67-47e7-91ae-485494fccbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:00.802771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:00.854698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41ffa7-c67c-48e2-9de0-cf3bbbbd3fc4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:00.870783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41ffa7-c67c-48e2-9de0-cf3bbbbd3fc4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:00.876776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa733156-bf29-463e-b729-c35b07fd3321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:00.877462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa733156-bf29-463e-b729-c35b07fd3321 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:00.877735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa733156-bf29-463e-b729-c35b07fd3321 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:00.878001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa733156-bf29-463e-b729-c35b07fd3321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:00.886793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa733156-bf29-463e-b729-c35b07fd3321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:00.888442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa733156-bf29-463e-b729-c35b07fd3321 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:00.898369 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 710/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:01.805458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee141ad-e9fa-47ff-b271-eb7bced10208 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:01.805995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee141ad-e9fa-47ff-b271-eb7bced10208 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:01.805995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee141ad-e9fa-47ff-b271-eb7bced10208 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:01.808140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:24:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:01.815943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4ccac-6bca-457d-8f42-30349ccdf369 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:01.816433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4ccac-6bca-457d-8f42-30349ccdf369 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:01.816433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4ccac-6bca-457d-8f42-30349ccdf369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:01.836372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9be4ccac-6bca-457d-8f42-30349ccdf369 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:01.837608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9be4ccac-6bca-457d-8f42-30349ccdf369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:01.846388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:24:01.996873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee141ad-e9fa-47ff-b271-eb7bced10208 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:02.022449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee141ad-e9fa-47ff-b271-eb7bced10208 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:02.029721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb131d9-63af-45bd-9e6a-986e0e4b734f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:02.030385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb131d9-63af-45bd-9e6a-986e0e4b734f service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:02.030669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb131d9-63af-45bd-9e6a-986e0e4b734f service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:02.030940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb131d9-63af-45bd-9e6a-986e0e4b734f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:02.039443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb131d9-63af-45bd-9e6a-986e0e4b734f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:02.041136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb131d9-63af-45bd-9e6a-986e0e4b734f service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:02.054486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 708/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:02.943109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a830-b3d5-435b-80ee-e58bc9df076b None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:02.943671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a830-b3d5-435b-80ee-e58bc9df076b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:02.943777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9a830-b3d5-435b-80ee-e58bc9df076b None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:02.946241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:24:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:02.952237 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e64e4-7363-41f9-b38f-3dc04cef1484 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:02.953076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e64e4-7363-41f9-b38f-3dc04cef1484 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:02.953293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e64e4-7363-41f9-b38f-3dc04cef1484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:02.975401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bc4e64e4-7363-41f9-b38f-3dc04cef1484 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:02.976597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bc4e64e4-7363-41f9-b38f-3dc04cef1484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:02.985492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:03.149733 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a830-b3d5-435b-80ee-e58bc9df076b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:03.168036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9a830-b3d5-435b-80ee-e58bc9df076b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:03.174232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5966e-19ae-4613-ba36-89778c880b93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:03.174880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5966e-19ae-4613-ba36-89778c880b93 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:03.175164 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5966e-19ae-4613-ba36-89778c880b93 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:03.175440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5966e-19ae-4613-ba36-89778c880b93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:03.184045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5966e-19ae-4613-ba36-89778c880b93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:03.185748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5966e-19ae-4613-ba36-89778c880b93 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:03.195892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 713/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:04.071184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d334415-4f97-4ae9-91cd-71fec19230a3 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:04.071976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d334415-4f97-4ae9-91cd-71fec19230a3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:04.072124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d334415-4f97-4ae9-91cd-71fec19230a3 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:04.074263 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:24:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:04.080323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6cc1-b769-4c0a-bc7d-4a6620a11c0e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:04.081011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6cc1-b769-4c0a-bc7d-4a6620a11c0e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:04.081320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6cc1-b769-4c0a-bc7d-4a6620a11c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:04.108153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-262e6cc1-b769-4c0a-bc7d-4a6620a11c0e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:04.109385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-262e6cc1-b769-4c0a-bc7d-4a6620a11c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:04.118707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:04.274842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d334415-4f97-4ae9-91cd-71fec19230a3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:04.301133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d334415-4f97-4ae9-91cd-71fec19230a3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:04.309050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7c4150-46b2-40ca-9d31-96d9c9a4fe31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:04.309696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4150-46b2-40ca-9d31-96d9c9a4fe31 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:04.309982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4150-46b2-40ca-9d31-96d9c9a4fe31 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:04.310259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7c4150-46b2-40ca-9d31-96d9c9a4fe31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:04.318601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c4150-46b2-40ca-9d31-96d9c9a4fe31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:04.320226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7c4150-46b2-40ca-9d31-96d9c9a4fe31 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:04.329902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 711/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:05.211292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1250c-db7c-40ff-a6f6-382c12dc31cc None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:05.211864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1250c-db7c-40ff-a6f6-382c12dc31cc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:05.211864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1250c-db7c-40ff-a6f6-382c12dc31cc None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:05.213414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:05.219901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e180c-65d2-4ae1-8a68-24485f7199b6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:05.220604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e180c-65d2-4ae1-8a68-24485f7199b6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:05.220789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e180c-65d2-4ae1-8a68-24485f7199b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:05.251240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1d8e180c-65d2-4ae1-8a68-24485f7199b6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:05.253058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1d8e180c-65d2-4ae1-8a68-24485f7199b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:05.266646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:05.417471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1250c-db7c-40ff-a6f6-382c12dc31cc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:05.433216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1250c-db7c-40ff-a6f6-382c12dc31cc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:05.439593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a39a1-c9e9-4def-afc3-8551f7fee4de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:05.440231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a39a1-c9e9-4def-afc3-8551f7fee4de service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:05.440513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a39a1-c9e9-4def-afc3-8551f7fee4de service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:05.440788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a39a1-c9e9-4def-afc3-8551f7fee4de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:05.449407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a39a1-c9e9-4def-afc3-8551f7fee4de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:05.450986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a39a1-c9e9-4def-afc3-8551f7fee4de service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:05.460533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 716/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:06.271158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9715d-5b90-45ae-bf9e-64fd0fc2a2bc None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:06.272019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9715d-5b90-45ae-bf9e-64fd0fc2a2bc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:06.272019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9715d-5b90-45ae-bf9e-64fd0fc2a2bc None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:06.274395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:24:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:06.280913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4af1c-b09e-4e2c-8761-3c8a37280ca1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:06.281344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4af1c-b09e-4e2c-8761-3c8a37280ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:06.281449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4af1c-b09e-4e2c-8761-3c8a37280ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:06.304456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bcf4af1c-b09e-4e2c-8761-3c8a37280ca1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:06.305668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bcf4af1c-b09e-4e2c-8761-3c8a37280ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:06.315844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:06.464905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9715d-5b90-45ae-bf9e-64fd0fc2a2bc None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:06.488882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9715d-5b90-45ae-bf9e-64fd0fc2a2bc None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:06.497336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84ea91-cd7d-4200-abdb-5465d3dcf9ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:06.497983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84ea91-cd7d-4200-abdb-5465d3dcf9ea service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:06.498267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84ea91-cd7d-4200-abdb-5465d3dcf9ea service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:06.498540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84ea91-cd7d-4200-abdb-5465d3dcf9ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:06.507611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84ea91-cd7d-4200-abdb-5465d3dcf9ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:06.509317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84ea91-cd7d-4200-abdb-5465d3dcf9ea service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:06.519293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 714/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:07.315237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142c9f7-884f-4477-bdc5-d9fc56b772d5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:07.315815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142c9f7-884f-4477-bdc5-d9fc56b772d5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:07.315815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142c9f7-884f-4477-bdc5-d9fc56b772d5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:07.317208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:07.323613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c306-f9a6-4a8b-9d34-ef43feada4dc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:07.324396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c306-f9a6-4a8b-9d34-ef43feada4dc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:07.324570 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c306-f9a6-4a8b-9d34-ef43feada4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:07.348461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f744c306-f9a6-4a8b-9d34-ef43feada4dc None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:07.349707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f744c306-f9a6-4a8b-9d34-ef43feada4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:07.359634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:24:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:24:07.510128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142c9f7-884f-4477-bdc5-d9fc56b772d5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:07.529704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142c9f7-884f-4477-bdc5-d9fc56b772d5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:07.535441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8fd60-7d84-4329-b853-3c0def5d498a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:07.536081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8fd60-7d84-4329-b853-3c0def5d498a service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:07.536363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8fd60-7d84-4329-b853-3c0def5d498a service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:07.536632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8fd60-7d84-4329-b853-3c0def5d498a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:07.546017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8fd60-7d84-4329-b853-3c0def5d498a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:07.548221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8fd60-7d84-4329-b853-3c0def5d498a service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:07.557869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 719/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:08.357406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71dfe0-c4a0-45da-83f6-64df5a83fa3f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:08.357986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71dfe0-c4a0-45da-83f6-64df5a83fa3f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:08.357986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71dfe0-c4a0-45da-83f6-64df5a83fa3f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:08.359325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:24:08.364589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2177d-6603-40e2-9259-0842dcaef454 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:08.365077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2177d-6603-40e2-9259-0842dcaef454 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:08.365212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2177d-6603-40e2-9259-0842dcaef454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:08.385379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f9e2177d-6603-40e2-9259-0842dcaef454 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:08.386559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f9e2177d-6603-40e2-9259-0842dcaef454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:08.394911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:08.554888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71dfe0-c4a0-45da-83f6-64df5a83fa3f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:08.571857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71dfe0-c4a0-45da-83f6-64df5a83fa3f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:08.577890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85863e27-6622-43bd-85fb-e84b7c046520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:08.578525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85863e27-6622-43bd-85fb-e84b7c046520 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:08.578808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85863e27-6622-43bd-85fb-e84b7c046520 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:08.579089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85863e27-6622-43bd-85fb-e84b7c046520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:08.587587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85863e27-6622-43bd-85fb-e84b7c046520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:08.589250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85863e27-6622-43bd-85fb-e84b7c046520 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:08.599114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 717/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:24:09.419235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963596-8ce7-493c-8b6f-48f5405406c6 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:09.419929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963596-8ce7-493c-8b6f-48f5405406c6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:09.419929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963596-8ce7-493c-8b6f-48f5405406c6 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:09.421261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:09.429595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21176246-f073-4187-ac04-0dc9a5089a06 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:09.430296 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21176246-f073-4187-ac04-0dc9a5089a06 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:09.430489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21176246-f073-4187-ac04-0dc9a5089a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:09.450203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-21176246-f073-4187-ac04-0dc9a5089a06 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:09.451434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-21176246-f073-4187-ac04-0dc9a5089a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:09.461014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:09.612792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963596-8ce7-493c-8b6f-48f5405406c6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:09.630506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963596-8ce7-493c-8b6f-48f5405406c6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:09.636519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a4107-6899-4563-aed6-9406923bf359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:09.637194 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a4107-6899-4563-aed6-9406923bf359 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:09.637477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a4107-6899-4563-aed6-9406923bf359 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:09.637754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a4107-6899-4563-aed6-9406923bf359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:09.646993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a4107-6899-4563-aed6-9406923bf359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:09.648605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277a4107-6899-4563-aed6-9406923bf359 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:09.658457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 722/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:11.587086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dfbc6-98db-4764-a6b1-239525aac6f1 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:11.587725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dfbc6-98db-4764-a6b1-239525aac6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:11.587725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dfbc6-98db-4764-a6b1-239525aac6f1 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:11.589053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:11.595840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61d299-adc7-4639-89f5-049ffd1fa81d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:11.596645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61d299-adc7-4639-89f5-049ffd1fa81d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:11.596790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61d299-adc7-4639-89f5-049ffd1fa81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:11.618106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4b61d299-adc7-4639-89f5-049ffd1fa81d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:11.619295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4b61d299-adc7-4639-89f5-049ffd1fa81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:11.629029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:11.668464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dfbc6-98db-4764-a6b1-239525aac6f1 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:11.679475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dfbc6-98db-4764-a6b1-239525aac6f1 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:11.683145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71fbbb-c3b5-4751-906a-048d3b105c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:11.683799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71fbbb-c3b5-4751-906a-048d3b105c7e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:11.684080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71fbbb-c3b5-4751-906a-048d3b105c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:11.684355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71fbbb-c3b5-4751-906a-048d3b105c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:11.693769 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71fbbb-c3b5-4751-906a-048d3b105c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:11.695234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71fbbb-c3b5-4751-906a-048d3b105c7e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:11.704733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 720/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:13.956603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79280ff-7f90-40a8-b10f-f50ee7cbe3a7 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:13.957250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79280ff-7f90-40a8-b10f-f50ee7cbe3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:13.957250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79280ff-7f90-40a8-b10f-f50ee7cbe3a7 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:13.958599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:13.965403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe2686-2e24-4a54-9ffb-5afc5cac8ba8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:13.966137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe2686-2e24-4a54-9ffb-5afc5cac8ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:13.966284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe2686-2e24-4a54-9ffb-5afc5cac8ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:13.998545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-76fe2686-2e24-4a54-9ffb-5afc5cac8ba8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:13.999684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-76fe2686-2e24-4a54-9ffb-5afc5cac8ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:14.009903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:24:14.049520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79280ff-7f90-40a8-b10f-f50ee7cbe3a7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:14.061495 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79280ff-7f90-40a8-b10f-f50ee7cbe3a7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:14.065662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a448c55-03e4-478b-a729-2f20c5d63021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:14.066307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448c55-03e4-478b-a729-2f20c5d63021 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:14.066611 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448c55-03e4-478b-a729-2f20c5d63021 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:14.066866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a448c55-03e4-478b-a729-2f20c5d63021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:14.076344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a448c55-03e4-478b-a729-2f20c5d63021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:14.077818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a448c55-03e4-478b-a729-2f20c5d63021 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:14.087571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 725/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:16.447459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29cfc-8f0c-433a-bea5-1aa39c34e7a2 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:16.448373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29cfc-8f0c-433a-bea5-1aa39c34e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:16.448373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d29cfc-8f0c-433a-bea5-1aa39c34e7a2 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:16.450587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:16.456271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74c0a3-2ac3-4756-8977-933e9f0f1f1b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:16.456713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74c0a3-2ac3-4756-8977-933e9f0f1f1b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:16.456809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74c0a3-2ac3-4756-8977-933e9f0f1f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:16.475684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fd74c0a3-2ac3-4756-8977-933e9f0f1f1b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:16.476879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fd74c0a3-2ac3-4756-8977-933e9f0f1f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:16.485307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:16.524498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29cfc-8f0c-433a-bea5-1aa39c34e7a2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:16.536183 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d29cfc-8f0c-433a-bea5-1aa39c34e7a2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:16.540002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c65ad2-ca14-427c-9305-2082ee035b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:16.540673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c65ad2-ca14-427c-9305-2082ee035b4a service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:16.540982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c65ad2-ca14-427c-9305-2082ee035b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:16.541256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c65ad2-ca14-427c-9305-2082ee035b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:16.550087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c65ad2-ca14-427c-9305-2082ee035b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:16.551581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c65ad2-ca14-427c-9305-2082ee035b4a service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:16.560991 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 723/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:18.743527 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319747-6a7d-4189-8d0b-88f815952091 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:18.744086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319747-6a7d-4189-8d0b-88f815952091 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:18.744086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319747-6a7d-4189-8d0b-88f815952091 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:18.746835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:18.752878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eddfc-c2fc-4bed-a92d-35c9ee5b50d5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:18.753335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eddfc-c2fc-4bed-a92d-35c9ee5b50d5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:18.753459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06eddfc-c2fc-4bed-a92d-35c9ee5b50d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:18.777059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e06eddfc-c2fc-4bed-a92d-35c9ee5b50d5 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:18.778287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e06eddfc-c2fc-4bed-a92d-35c9ee5b50d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:18.787126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:18.830599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319747-6a7d-4189-8d0b-88f815952091 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:18.846717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319747-6a7d-4189-8d0b-88f815952091 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:18.850748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc5304-4e72-42e9-a779-c47ecf62c070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:18.851649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5304-4e72-42e9-a779-c47ecf62c070 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:18.851930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5304-4e72-42e9-a779-c47ecf62c070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:18.852198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc5304-4e72-42e9-a779-c47ecf62c070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:18.862209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc5304-4e72-42e9-a779-c47ecf62c070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:18.863668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc5304-4e72-42e9-a779-c47ecf62c070 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:18.873869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 728/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:21.021539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04ee2-f3d3-44a7-8b7b-c09a80d6582e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:21.022377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04ee2-f3d3-44a7-8b7b-c09a80d6582e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:21.022377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04ee2-f3d3-44a7-8b7b-c09a80d6582e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:21.024476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:21.030326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322aa64-f555-482f-8fb5-ed5061711ddc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:21.030793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322aa64-f555-482f-8fb5-ed5061711ddc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:21.030890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322aa64-f555-482f-8fb5-ed5061711ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:21.050069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6322aa64-f555-482f-8fb5-ed5061711ddc None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:21.051261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6322aa64-f555-482f-8fb5-ed5061711ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:21.060333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:24:21.098317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04ee2-f3d3-44a7-8b7b-c09a80d6582e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:21.110481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04ee2-f3d3-44a7-8b7b-c09a80d6582e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:21.114507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e2d61-2d9d-47ac-8f7b-e03b8b28fda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:21.115151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e2d61-2d9d-47ac-8f7b-e03b8b28fda2 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:21.115436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e2d61-2d9d-47ac-8f7b-e03b8b28fda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:21.115709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e2d61-2d9d-47ac-8f7b-e03b8b28fda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:21.126490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e2d61-2d9d-47ac-8f7b-e03b8b28fda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:21.127962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e2d61-2d9d-47ac-8f7b-e03b8b28fda2 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:21.138424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 726/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:23.275258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0fe91-09bf-445d-acf0-7ac4d8b5f2c5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:23.276042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0fe91-09bf-445d-acf0-7ac4d8b5f2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:23.276042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0fe91-09bf-445d-acf0-7ac4d8b5f2c5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:23.278200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:23.286996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e2b4-cecb-4d69-9121-215ddf6e10eb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:23.287765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e2b4-cecb-4d69-9121-215ddf6e10eb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:23.288074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e2b4-cecb-4d69-9121-215ddf6e10eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:23.308236 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3326e2b4-cecb-4d69-9121-215ddf6e10eb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:23.309491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3326e2b4-cecb-4d69-9121-215ddf6e10eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:23.319561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:23.361910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0fe91-09bf-445d-acf0-7ac4d8b5f2c5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:23.376672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0fe91-09bf-445d-acf0-7ac4d8b5f2c5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:23.380782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ace75-136f-4f6d-9dc9-d9683a26d897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:23.381469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ace75-136f-4f6d-9dc9-d9683a26d897 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:23.381739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ace75-136f-4f6d-9dc9-d9683a26d897 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:23.382010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ace75-136f-4f6d-9dc9-d9683a26d897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:23.391875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ace75-136f-4f6d-9dc9-d9683a26d897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:23.393365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ace75-136f-4f6d-9dc9-d9683a26d897 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:23.403317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 731/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:25.523459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea522b-a8f0-4858-8f35-75d28806f72a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:25.524060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea522b-a8f0-4858-8f35-75d28806f72a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:25.524060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea522b-a8f0-4858-8f35-75d28806f72a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:25.525495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:25.532925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123990-bec9-4e5c-b9f4-b3d93100f3f0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:25.533359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123990-bec9-4e5c-b9f4-b3d93100f3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:25.533472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be123990-bec9-4e5c-b9f4-b3d93100f3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:25.552347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-be123990-bec9-4e5c-b9f4-b3d93100f3f0 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:25.553602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-be123990-bec9-4e5c-b9f4-b3d93100f3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:25.562172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:25.603737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea522b-a8f0-4858-8f35-75d28806f72a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:25.621968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea522b-a8f0-4858-8f35-75d28806f72a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:25.626471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aa252-a928-46b1-99f0-144d7a870b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:25.627120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa252-a928-46b1-99f0-144d7a870b1e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:25.627400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa252-a928-46b1-99f0-144d7a870b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:25.627673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa252-a928-46b1-99f0-144d7a870b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:25.637333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4aa252-a928-46b1-99f0-144d7a870b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:25.638874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4aa252-a928-46b1-99f0-144d7a870b1e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:25.648773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 729/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:27.718844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ae750-846f-466c-8a03-4d4703b31ef0 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:27.719422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ae750-846f-466c-8a03-4d4703b31ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:27.719422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ae750-846f-466c-8a03-4d4703b31ef0 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:27.720801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:24:27.726440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789767b-0b5c-44db-98ca-28dcb2effd9d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:27.726889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789767b-0b5c-44db-98ca-28dcb2effd9d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:27.726988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789767b-0b5c-44db-98ca-28dcb2effd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:27.733731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=79 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:24:27.748358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4789767b-0b5c-44db-98ca-28dcb2effd9d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:27.749645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4789767b-0b5c-44db-98ca-28dcb2effd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:27.761335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:27.801290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ae750-846f-466c-8a03-4d4703b31ef0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:27.808859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=73 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:24:27.815220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ae750-846f-466c-8a03-4d4703b31ef0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:27.819170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e7cc4-9cfb-4309-8974-f377dce2f204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:27.819809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e7cc4-9cfb-4309-8974-f377dce2f204 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:27.820092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e7cc4-9cfb-4309-8974-f377dce2f204 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:27.820366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e7cc4-9cfb-4309-8974-f377dce2f204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:27.829633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e7cc4-9cfb-4309-8974-f377dce2f204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:27.831070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e7cc4-9cfb-4309-8974-f377dce2f204 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:27.840332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 734/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:29.877667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321ec4-c9b9-416e-b189-3a5499a4478f None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:29.878492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321ec4-c9b9-416e-b189-3a5499a4478f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:29.878492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15321ec4-c9b9-416e-b189-3a5499a4478f None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:29.880759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:29.887109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442434-39c5-4870-8af7-33940f740f45 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:29.887549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442434-39c5-4870-8af7-33940f740f45 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:29.887729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7442434-39c5-4870-8af7-33940f740f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:29.916211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b7442434-39c5-4870-8af7-33940f740f45 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:29.917464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b7442434-39c5-4870-8af7-33940f740f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:29.926851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:29.966063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321ec4-c9b9-416e-b189-3a5499a4478f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:29.978112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15321ec4-c9b9-416e-b189-3a5499a4478f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:29.982405 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f134-fab5-4776-90fb-934f5838f46e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:29.983042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f134-fab5-4776-90fb-934f5838f46e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:29.983323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f134-fab5-4776-90fb-934f5838f46e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:29.983594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f134-fab5-4776-90fb-934f5838f46e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:29.993390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f134-fab5-4776-90fb-934f5838f46e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:29.994912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f134-fab5-4776-90fb-934f5838f46e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:30.004313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 732/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:32.047154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c30b7-5ceb-4cfc-88a9-8cf6add16733 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:32.047154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c30b7-5ceb-4cfc-88a9-8cf6add16733 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:32.047154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c30b7-5ceb-4cfc-88a9-8cf6add16733 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:32.048581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:32.056364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5485b-8add-447b-95c4-9eb0bf6fe102 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:32.057076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5485b-8add-447b-95c4-9eb0bf6fe102 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:32.057271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5485b-8add-447b-95c4-9eb0bf6fe102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:32.081796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7bd5485b-8add-447b-95c4-9eb0bf6fe102 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:32.083015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7bd5485b-8add-447b-95c4-9eb0bf6fe102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:32.091762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:32.129594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c30b7-5ceb-4cfc-88a9-8cf6add16733 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:32.142095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c30b7-5ceb-4cfc-88a9-8cf6add16733 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:32.145773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d085f-cfa4-4a15-a401-f3b8dedfab24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:32.146410 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d085f-cfa4-4a15-a401-f3b8dedfab24 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:32.146687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d085f-cfa4-4a15-a401-f3b8dedfab24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:32.146957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d085f-cfa4-4a15-a401-f3b8dedfab24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:32.156036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d085f-cfa4-4a15-a401-f3b8dedfab24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:32.157493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d085f-cfa4-4a15-a401-f3b8dedfab24 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:32.167213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 737/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:42.076190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=11 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:24:42.162669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=14 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:24:52.382411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b64cb-e4ce-47e5-a526-d585e8652390 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:52.383050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b64cb-e4ce-47e5-a526-d585e8652390 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:52.383050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b64cb-e4ce-47e5-a526-d585e8652390 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:52.385035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 734/1471] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:52.390986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d622c7-a21f-4dad-8a3d-d6c29f298c10 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:52.391435 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d622c7-a21f-4dad-8a3d-d6c29f298c10 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:52.391536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d622c7-a21f-4dad-8a3d-d6c29f298c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:52.411924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d9d622c7-a21f-4dad-8a3d-d6c29f298c10 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:52.413195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d9d622c7-a21f-4dad-8a3d-d6c29f298c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:52.422832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 738/1472] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:52.473453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6f989-bc00-48ab-86ed-e0b9d241c760 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:52.473744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6f989-bc00-48ab-86ed-e0b9d241c760 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:52.474017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6f989-bc00-48ab-86ed-e0b9d241c760 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:52.475429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 735/1473] 10.222.0.59 () {54 vars in 962 bytes} [Fri Jul 1 16:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:52.481911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c9dbe-7e2f-406c-a96c-ee8972a30668 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:52.482199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c9dbe-7e2f-406c-a96c-ee8972a30668 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:52.482477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c9dbe-7e2f-406c-a96c-ee8972a30668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:52.501672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-250c9dbe-7e2f-406c-a96c-ee8972a30668 None None] MFA Rules not processed for user `87a4ed0881004eef94166ace450b8a63`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:52.502864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-250c9dbe-7e2f-406c-a96c-ee8972a30668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:52.510127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 739/1474] 10.222.0.59 () {58 vars in 1059 bytes} [Fri Jul 1 16:24:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:52.521198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6f989-bc00-48ab-86ed-e0b9d241c760 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:52.536280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6f989-bc00-48ab-86ed-e0b9d241c760 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:52.542694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eae3c-8b08-4159-986e-8edbe6865665 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a4ed0881004eef94166ace450b8a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:52.543340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eae3c-8b08-4159-986e-8edbe6865665 service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:52.543619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eae3c-8b08-4159-986e-8edbe6865665 service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:52.543889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eae3c-8b08-4159-986e-8edbe6865665 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:52.553836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eae3c-8b08-4159-986e-8edbe6865665 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:52.555306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eae3c-8b08-4159-986e-8edbe6865665 service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:52.565037 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 736/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:54.693324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cd1d0-aeff-4408-8ef1-a9466e6d94e8 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:54.693972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cd1d0-aeff-4408-8ef1-a9466e6d94e8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:54.693972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cd1d0-aeff-4408-8ef1-a9466e6d94e8 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:54.695293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 740/1476] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:54.701923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963a22c-08a8-4bbf-be0b-eeeb92bbdf84 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:54.702704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963a22c-08a8-4bbf-be0b-eeeb92bbdf84 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:54.702855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963a22c-08a8-4bbf-be0b-eeeb92bbdf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:54.732151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1963a22c-08a8-4bbf-be0b-eeeb92bbdf84 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:54.733410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1963a22c-08a8-4bbf-be0b-eeeb92bbdf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:54.743522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 737/1477] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:54.766872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cd1d0-aeff-4408-8ef1-a9466e6d94e8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:54.782039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cd1d0-aeff-4408-8ef1-a9466e6d94e8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:54.788059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5283d-e4c3-4f7c-9810-0ad28caf4f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:54.788706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5283d-e4c3-4f7c-9810-0ad28caf4f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:54.789020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5283d-e4c3-4f7c-9810-0ad28caf4f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:54.789294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5283d-e4c3-4f7c-9810-0ad28caf4f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:54.790020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5283d-e4c3-4f7c-9810-0ad28caf4f8c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:54.791845 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-fce5283d-e4c3-4f7c-9810-0ad28caf4f8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:24:54.791845 dv-cinder-844961-1-smb devstack@keystone.service[80130]: warnings.warn(msg) Jul 01 16:24:54.791845 dv-cinder-844961-1-smb devstack@keystone.service[80130]: Jul 01 16:24:54.793026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5283d-e4c3-4f7c-9810-0ad28caf4f8c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:54.812519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 741/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Fri Jul 1 16:24:54 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:24:56.857777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b8dcf-5ac2-49d7-b90c-3c190d318483 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:56.858368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b8dcf-5ac2-49d7-b90c-3c190d318483 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:56.858368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b8dcf-5ac2-49d7-b90c-3c190d318483 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:56.859769 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 738/1479] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:56.865427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d00-6733-41e4-aea3-7f04c57b62c3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:56.865880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d00-6733-41e4-aea3-7f04c57b62c3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:56.865985 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c0d00-6733-41e4-aea3-7f04c57b62c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:56.885279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-307c0d00-6733-41e4-aea3-7f04c57b62c3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:56.886480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-307c0d00-6733-41e4-aea3-7f04c57b62c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:56.896675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 742/1480] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:24:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:56.944584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b8dcf-5ac2-49d7-b90c-3c190d318483 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:56.962340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b8dcf-5ac2-49d7-b90c-3c190d318483 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:56.969490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa454888-25fd-4551-93d1-454ff8f7e2a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:56.970130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa454888-25fd-4551-93d1-454ff8f7e2a7 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:56.970407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa454888-25fd-4551-93d1-454ff8f7e2a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:56.970677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa454888-25fd-4551-93d1-454ff8f7e2a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:56.979760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa454888-25fd-4551-93d1-454ff8f7e2a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:56.981439 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa454888-25fd-4551-93d1-454ff8f7e2a7 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:56.991393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 739/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:24:59.201914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e3ce4-299f-4c1f-acde-127682ce1833 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:59.202514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e3ce4-299f-4c1f-acde-127682ce1833 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:59.202514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e3ce4-299f-4c1f-acde-127682ce1833 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:59.203856 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 743/1482] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:24:59.209492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4c462-beb0-47b6-905a-801718a73220 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:59.209941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4c462-beb0-47b6-905a-801718a73220 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:59.210057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4c462-beb0-47b6-905a-801718a73220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:59.229172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ace4c462-beb0-47b6-905a-801718a73220 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:24:59.230382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ace4c462-beb0-47b6-905a-801718a73220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:24:59.239052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 740/1483] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:24:59.275252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e3ce4-299f-4c1f-acde-127682ce1833 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:24:59.289068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e3ce4-299f-4c1f-acde-127682ce1833 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:24:59.292956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e688e28-1b2d-4b81-99ea-57c0af70f1b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:24:59.293666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688e28-1b2d-4b81-99ea-57c0af70f1b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:24:59.293945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688e28-1b2d-4b81-99ea-57c0af70f1b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:24:59.294223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e688e28-1b2d-4b81-99ea-57c0af70f1b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:24:59.304032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e688e28-1b2d-4b81-99ea-57c0af70f1b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:24:59.305598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e688e28-1b2d-4b81-99ea-57c0af70f1b4 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:24:59.315562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 744/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:25:01.425580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae7f84-5d67-4f0f-b89e-65184fd8d844 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:25:01.426186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae7f84-5d67-4f0f-b89e-65184fd8d844 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:25:01.426186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae7f84-5d67-4f0f-b89e-65184fd8d844 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:25:01.427535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 741/1485] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:25:01.434102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c838a0-ef2a-4223-ba55-cc68dc003385 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:25:01.434562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c838a0-ef2a-4223-ba55-cc68dc003385 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:25:01.434659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c838a0-ef2a-4223-ba55-cc68dc003385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:25:01.459370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b2c838a0-ef2a-4223-ba55-cc68dc003385 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:25:01.460592 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b2c838a0-ef2a-4223-ba55-cc68dc003385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:25:01.469612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 745/1486] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:25:01.510882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae7f84-5d67-4f0f-b89e-65184fd8d844 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:25:01.529872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae7f84-5d67-4f0f-b89e-65184fd8d844 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:25:01.534032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424bdeb-896a-41e8-8dc1-64ebaf136722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:25:01.534684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424bdeb-896a-41e8-8dc1-64ebaf136722 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:25:01.534968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424bdeb-896a-41e8-8dc1-64ebaf136722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:25:01.535235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424bdeb-896a-41e8-8dc1-64ebaf136722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:25:01.545048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424bdeb-896a-41e8-8dc1-64ebaf136722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:25:01.546482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424bdeb-896a-41e8-8dc1-64ebaf136722 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:25:01.556318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 742/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:25:03.739362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ddc7-d3c4-43b6-a57b-0acc7efa7865 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:25:03.740191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ddc7-d3c4-43b6-a57b-0acc7efa7865 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:25:03.740191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958ddc7-d3c4-43b6-a57b-0acc7efa7865 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:25:03.742377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 746/1488] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:25:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:25:03.748119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c9f0d-299f-4850-9dac-eee95cde9cdb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:25:03.748633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c9f0d-299f-4850-9dac-eee95cde9cdb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:25:03.748740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c9f0d-299f-4850-9dac-eee95cde9cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:25:03.766959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-248c9f0d-299f-4850-9dac-eee95cde9cdb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:25:03.768176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-248c9f0d-299f-4850-9dac-eee95cde9cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:25:03.776809 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 743/1489] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:25:03.819603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958ddc7-d3c4-43b6-a57b-0acc7efa7865 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:25:03.831758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958ddc7-d3c4-43b6-a57b-0acc7efa7865 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:25:03.836124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5faae2-c259-4fc2-8a83-e7d15af0e5fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:25:03.836767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5faae2-c259-4fc2-8a83-e7d15af0e5fe service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:25:03.837077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5faae2-c259-4fc2-8a83-e7d15af0e5fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:25:03.837354 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5faae2-c259-4fc2-8a83-e7d15af0e5fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:25:03.847262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5faae2-c259-4fc2-8a83-e7d15af0e5fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:25:03.848715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5faae2-c259-4fc2-8a83-e7d15af0e5fe service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:25:03.858235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 747/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:25:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:25:06.068974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1dcfa-e9c3-4ee2-ab85-d47fd6145aa4 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:25:06.069367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1dcfa-e9c3-4ee2-ab85-d47fd6145aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:25:06.069652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1dcfa-e9c3-4ee2-ab85-d47fd6145aa4 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:25:06.071052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 744/1491] 10.222.0.59 () {54 vars in 926 bytes} [Fri Jul 1 16:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:25:06.079773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdf080-c77d-46f9-ac7f-a5ec700a259b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:25:06.080570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdf080-c77d-46f9-ac7f-a5ec700a259b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:25:06.080764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdf080-c77d-46f9-ac7f-a5ec700a259b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:25:06.104581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-03bdf080-c77d-46f9-ac7f-a5ec700a259b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:25:06.105897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-03bdf080-c77d-46f9-ac7f-a5ec700a259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:25:06.114562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 748/1492] 10.222.0.59 () {58 vars in 1023 bytes} [Fri Jul 1 16:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:25:06.153806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1dcfa-e9c3-4ee2-ab85-d47fd6145aa4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:25:06.167558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1dcfa-e9c3-4ee2-ab85-d47fd6145aa4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:25:06.172312 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d79e8a-0af6-49de-9fc1-f081ab71c1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:25:06.172992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79e8a-0af6-49de-9fc1-f081ab71c1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:25:06.173282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79e8a-0af6-49de-9fc1-f081ab71c1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:25:06.173558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79e8a-0af6-49de-9fc1-f081ab71c1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:25:06.184395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d79e8a-0af6-49de-9fc1-f081ab71c1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:25:06.186570 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d79e8a-0af6-49de-9fc1-f081ab71c1a4 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:25:06.196363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 745/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:25:16.099049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=33 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:25:16.191942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=33 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:26:32.598543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0595ea-4730-48b9-981e-9372d5652e29 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:32.599166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0595ea-4730-48b9-981e-9372d5652e29 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:32.599166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0595ea-4730-48b9-981e-9372d5652e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:32.618553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9a0595ea-4730-48b9-981e-9372d5652e29 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:26:32.619735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9a0595ea-4730-48b9-981e-9372d5652e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:26:32.628131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 749/1494] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:26:32.636495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602b1c-d726-4db1-bc3c-fe7fdff5bc92 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:32.637048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602b1c-d726-4db1-bc3c-fe7fdff5bc92 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:32.637048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6602b1c-d726-4db1-bc3c-fe7fdff5bc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:32.656943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a6602b1c-d726-4db1-bc3c-fe7fdff5bc92 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:26:32.658128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a6602b1c-d726-4db1-bc3c-fe7fdff5bc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:26:32.666552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 746/1495] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:26:32.671253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0595ea-4730-48b9-981e-9372d5652e29 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:32.681115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0595ea-4730-48b9-981e-9372d5652e29 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:32.686640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:32.687291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:32.687567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:32.687838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:32.688555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:26:32.688881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:32.689923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:26:32.689923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: warnings.warn(msg) Jul 01 16:26:32.689923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: Jul 01 16:26:32.690825 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:32.702398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 750/1496] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:26:32.710621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6602b1c-d726-4db1-bc3c-fe7fdff5bc92 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:32.719932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6602b1c-d726-4db1-bc3c-fe7fdff5bc92 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:32.725407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5bdc3-ffe5-48c5-a2bc-7074fcb99a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:32.726064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5bdc3-ffe5-48c5-a2bc-7074fcb99a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:32.726339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5bdc3-ffe5-48c5-a2bc-7074fcb99a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:32.726607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5bdc3-ffe5-48c5-a2bc-7074fcb99a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:32.727298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5bdc3-ffe5-48c5-a2bc-7074fcb99a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:32.729096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-2bc5bdc3-ffe5-48c5-a2bc-7074fcb99a91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:26:32.729096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: warnings.warn(msg) Jul 01 16:26:32.729096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: Jul 01 16:26:32.730297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5bdc3-ffe5-48c5-a2bc-7074fcb99a91 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:32.775195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 747/1497] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:26:32 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:26:32.779876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:32.790390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cce636-98d6-4655-a7d0-8d70d01ad792 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:32.849916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b343a-bd46-460c-b42d-be96f03d723e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:32.850505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b343a-bd46-460c-b42d-be96f03d723e admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:32.850778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b343a-bd46-460c-b42d-be96f03d723e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:32.851059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b343a-bd46-460c-b42d-be96f03d723e admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:32.851738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b343a-bd46-460c-b42d-be96f03d723e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:32.852757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-e71b343a-bd46-460c-b42d-be96f03d723e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:26:32.852757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: warnings.warn(msg) Jul 01 16:26:32.852757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: Jul 01 16:26:32.853996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b343a-bd46-460c-b42d-be96f03d723e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:32.878791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 751/1498] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:26:32 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:26:32.880081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5bdc3-ffe5-48c5-a2bc-7074fcb99a91 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:32.890304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5bdc3-ffe5-48c5-a2bc-7074fcb99a91 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:32.895358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ae51-a2ff-4038-9195-ead9d0dfb9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:32.896016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ae51-a2ff-4038-9195-ead9d0dfb9de admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:32.896293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ae51-a2ff-4038-9195-ead9d0dfb9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:32.896569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ae51-a2ff-4038-9195-ead9d0dfb9de admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:32.897340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3ae51-a2ff-4038-9195-ead9d0dfb9de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:32.898355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-71e3ae51-a2ff-4038-9195-ead9d0dfb9de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:26:32.898355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: warnings.warn(msg) Jul 01 16:26:32.898355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: Jul 01 16:26:32.899248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3ae51-a2ff-4038-9195-ead9d0dfb9de admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:32.912022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 748/1499] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:26:32.916176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b343a-bd46-460c-b42d-be96f03d723e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:32.926604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b343a-bd46-460c-b42d-be96f03d723e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:32.931801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49762c8c-de18-4446-9b00-94e615e4cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:32.932473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49762c8c-de18-4446-9b00-94e615e4cba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:32.932755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49762c8c-de18-4446-9b00-94e615e4cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:32.933061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49762c8c-de18-4446-9b00-94e615e4cba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:32.933792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49762c8c-de18-4446-9b00-94e615e4cba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:32.934808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-49762c8c-de18-4446-9b00-94e615e4cba2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:26:32.934808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: warnings.warn(msg) Jul 01 16:26:32.934808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: Jul 01 16:26:32.935707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49762c8c-de18-4446-9b00-94e615e4cba2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:32.949431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 752/1500] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:26:32.953464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ae51-a2ff-4038-9195-ead9d0dfb9de admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:32.963874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ae51-a2ff-4038-9195-ead9d0dfb9de admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:32.968779 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d6803-65fe-41a1-b5ab-d4d042fbe6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:32.969785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d6803-65fe-41a1-b5ab-d4d042fbe6b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:32.970415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d6803-65fe-41a1-b5ab-d4d042fbe6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:32.970415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d6803-65fe-41a1-b5ab-d4d042fbe6b9 admin admin] PATH_INFO: `/v3/projects/a93b69ab5c554e2ba89317eeb6c472c3/users/0fb0cfdf2e214c24ac74d2266b53f7cb/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:32.987936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d6803-65fe-41a1-b5ab-d4d042fbe6b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93b69ab5c554e2ba89317eeb6c472c3, user_id=0fb0cfdf2e214c24ac74d2266b53f7cb, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:32.989018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-3a6d6803-65fe-41a1-b5ab-d4d042fbe6b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:26:32.989018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: warnings.warn(msg) Jul 01 16:26:32.989018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: Jul 01 16:26:32.990981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d6803-65fe-41a1-b5ab-d4d042fbe6b9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:33.005834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 749/1501] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:26:32 2022] PUT /identity/v3/projects/a93b69ab5c554e2ba89317eeb6c472c3/users/0fb0cfdf2e214c24ac74d2266b53f7cb/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:26:33.018456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d873022-ccaf-42a9-8ad0-bf1d5706518e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:33.018773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d873022-ccaf-42a9-8ad0-bf1d5706518e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:33.019042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d873022-ccaf-42a9-8ad0-bf1d5706518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:33.046188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6d873022-ccaf-42a9-8ad0-bf1d5706518e None None] MFA Rules not processed for user `0fb0cfdf2e214c24ac74d2266b53f7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:26:33.047390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6d873022-ccaf-42a9-8ad0-bf1d5706518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:26:33.114746 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 753/1502] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:26:33.130804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518ea72-0031-420d-adda-f4e9956c0afd None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:33.131093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518ea72-0031-420d-adda-f4e9956c0afd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:33.131367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518ea72-0031-420d-adda-f4e9956c0afd None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:33.132763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 750/1503] 10.222.0.59 () {54 vars in 963 bytes} [Fri Jul 1 16:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:26:33.137829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc946b5-a119-47b5-ac19-6199b6eee8a8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:33.138153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc946b5-a119-47b5-ac19-6199b6eee8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:33.138418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc946b5-a119-47b5-ac19-6199b6eee8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:33.157598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4fc946b5-a119-47b5-ac19-6199b6eee8a8 None None] MFA Rules not processed for user `c4980d7e51e84655add2a53808818598`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:26:33.158857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4fc946b5-a119-47b5-ac19-6199b6eee8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:26:33.204027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:26:33.213678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 754/1504] 10.222.0.59 () {58 vars in 1060 bytes} [Fri Jul 1 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:26:33.221991 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518ea72-0031-420d-adda-f4e9956c0afd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:33.232776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518ea72-0031-420d-adda-f4e9956c0afd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:33.236701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472912f-d739-442e-9b9a-149f2001476d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:33.237374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472912f-d739-442e-9b9a-149f2001476d service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:33.237651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472912f-d739-442e-9b9a-149f2001476d service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:33.237927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472912f-d739-442e-9b9a-149f2001476d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:33.246621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472912f-d739-442e-9b9a-149f2001476d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:33.248066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f472912f-d739-442e-9b9a-149f2001476d service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:33.262953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 751/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:26:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:26:33.313797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4adc-d9e7-40fc-aca4-3d2b71f5d61d None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:33.314095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4adc-d9e7-40fc-aca4-3d2b71f5d61d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:33.314371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f4adc-d9e7-40fc-aca4-3d2b71f5d61d None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:33.315864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 755/1506] 10.222.0.59 () {52 vars in 829 bytes} [Fri Jul 1 16:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:26:33.319700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472912f-d739-442e-9b9a-149f2001476d service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:33.386498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472912f-d739-442e-9b9a-149f2001476d service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:33.391139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:33.392011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:33.392292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:33.392563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] PATH_INFO: `/v3/users/0fb0cfdf2e214c24ac74d2266b53f7cb` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:33.393891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb0cfdf2e214c24ac74d2266b53f7cb)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:33.394921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:26:33.394921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: warnings.warn(msg) Jul 01 16:26:33.394921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: Jul 01 16:26:33.396130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:33.474436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb0cfdf2e214c24ac74d2266b53f7cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:33.475085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb0cfdf2e214c24ac74d2266b53f7cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:33.475807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb0cfdf2e214c24ac74d2266b53f7cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:33.495254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb0cfdf2e214c24ac74d2266b53f7cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:33.508768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb0cfdf2e214c24ac74d2266b53f7cb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:33.514146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:26:33.528327 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 752/1507] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:26:33 2022] DELETE /identity/v3/users/0fb0cfdf2e214c24ac74d2266b53f7cb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:26:33.533609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcb70e-5e0d-4707-818c-9d957bdef5ca None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:33.533897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcb70e-5e0d-4707-818c-9d957bdef5ca None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:33.534218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdcb70e-5e0d-4707-818c-9d957bdef5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:33.552039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2cdcb70e-5e0d-4707-818c-9d957bdef5ca None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:26:33.553263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2cdcb70e-5e0d-4707-818c-9d957bdef5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:26:33.615815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 756/1508] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:26:33.626277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:33.627839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:26:33.694744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398b931-012f-4160-8c2e-9c07b5f91b2c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:33.698748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe932-ad96-4142-bfe2-1ef2756dd82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:33.699417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe932-ad96-4142-bfe2-1ef2756dd82a service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:33.699698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe932-ad96-4142-bfe2-1ef2756dd82a service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:33.699969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe932-ad96-4142-bfe2-1ef2756dd82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:33.710624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defe932-ad96-4142-bfe2-1ef2756dd82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:33.712082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defe932-ad96-4142-bfe2-1ef2756dd82a service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:33.724243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 753/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:26:34.069190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcb70e-5e0d-4707-818c-9d957bdef5ca None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:26:34.070756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2cdcb70e-5e0d-4707-818c-9d957bdef5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:26:34.083303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdcb70e-5e0d-4707-818c-9d957bdef5ca None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:26:34.089689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:26:34.090727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:26:34.091087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:26:34.091270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] PATH_INFO: `/v3/projects/a93b69ab5c554e2ba89317eeb6c472c3` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:26:34.093315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93b69ab5c554e2ba89317eeb6c472c3)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:26:34.094539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:26:34.094539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: warnings.warn(msg) Jul 01 16:26:34.094539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: Jul 01 16:26:34.095773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:26:34.161375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93b69ab5c554e2ba89317eeb6c472c3', 'request_id': 'req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:34.167340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93b69ab5c554e2ba89317eeb6c472c3', 'request_id': 'req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:34.179635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93b69ab5c554e2ba89317eeb6c472c3', 'request_id': 'req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:34.198977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] The token cache is being invalidate because project a93b69ab5c554e2ba89317eeb6c472c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:26:34.199259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:34.199944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cf0528b6-4c25-4b0b-824b-2c3094f0cd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:26:34.201701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 757/1510] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:26:34 2022] DELETE /identity/v3/projects/a93b69ab5c554e2ba89317eeb6c472c3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:26:43.717573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:26:44.196050 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:28:23.454196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2ef56-9087-499a-b9cd-dc7fbb61ff6e None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:23.454847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2ef56-9087-499a-b9cd-dc7fbb61ff6e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:23.454847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2ef56-9087-499a-b9cd-dc7fbb61ff6e None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:23.456272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:28:23.462547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982387-9046-4d91-85a8-0f3ce62426c5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:23.463395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982387-9046-4d91-85a8-0f3ce62426c5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:23.463395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982387-9046-4d91-85a8-0f3ce62426c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:23.484423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0c982387-9046-4d91-85a8-0f3ce62426c5 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:23.485734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0c982387-9046-4d91-85a8-0f3ce62426c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:23.548724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:28:23.704875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2ef56-9087-499a-b9cd-dc7fbb61ff6e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:28:23.706807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-acf2ef56-9087-499a-b9cd-dc7fbb61ff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:23.784370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2ef56-9087-499a-b9cd-dc7fbb61ff6e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:28:23.790214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad0b09-5567-4bff-86ff-c05d80282d80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:28:23.790860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad0b09-5567-4bff-86ff-c05d80282d80 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:23.791150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad0b09-5567-4bff-86ff-c05d80282d80 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:23.791427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad0b09-5567-4bff-86ff-c05d80282d80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:23.800050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad0b09-5567-4bff-86ff-c05d80282d80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:28:23.801718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad0b09-5567-4bff-86ff-c05d80282d80 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:28:23.811833 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 755/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:28:24.636750 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99f608-be72-4e35-915d-a249fdec5333 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:24.637696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99f608-be72-4e35-915d-a249fdec5333 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:24.637696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99f608-be72-4e35-915d-a249fdec5333 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:24.639940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:28:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:28:24.645219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12ad73-f9fc-4ec3-b120-4ce8df4edc7b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:24.645669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12ad73-f9fc-4ec3-b120-4ce8df4edc7b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:24.645767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12ad73-f9fc-4ec3-b120-4ce8df4edc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:24.666311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6f12ad73-f9fc-4ec3-b120-4ce8df4edc7b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:24.667540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6f12ad73-f9fc-4ec3-b120-4ce8df4edc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:24.679464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:28:24.847566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99f608-be72-4e35-915d-a249fdec5333 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:28:24.872193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99f608-be72-4e35-915d-a249fdec5333 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:28:24.879272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04c70-fef3-40eb-b3a1-ff6f25977bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:28:24.879923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04c70-fef3-40eb-b3a1-ff6f25977bca service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:24.880207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04c70-fef3-40eb-b3a1-ff6f25977bca service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:24.880495 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04c70-fef3-40eb-b3a1-ff6f25977bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:24.889292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04c70-fef3-40eb-b3a1-ff6f25977bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:28:24.891391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04c70-fef3-40eb-b3a1-ff6f25977bca service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:28:24.900822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 760/1516] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:28:25.169670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5f3c0-be09-46a0-b5f4-635c1902a944 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:25.169901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5f3c0-be09-46a0-b5f4-635c1902a944 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:25.170152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5f3c0-be09-46a0-b5f4-635c1902a944 None None] PATH_INFO: `/v3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:25.171484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 757/1517] 10.222.0.58 () {54 vars in 925 bytes} [Fri Jul 1 16:28:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:28:25.179649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0041753-2479-454f-b700-eb17d585cdf6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:25.179938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0041753-2479-454f-b700-eb17d585cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:25.180217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0041753-2479-454f-b700-eb17d585cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:25.200314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c0041753-2479-454f-b700-eb17d585cdf6 None None] MFA Rules not processed for user `eb3ded7163fa400399d1b09079a366ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:25.201584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c0041753-2479-454f-b700-eb17d585cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:25.276626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 761/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jul 1 16:28:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:28:34.173773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8f983-2e5b-4a27-88c1-812c00b4e5a2 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:34.174412 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8f983-2e5b-4a27-88c1-812c00b4e5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:34.174517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8f983-2e5b-4a27-88c1-812c00b4e5a2 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:34.175897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 758/1519] 10.222.0.59 () {54 vars in 960 bytes} [Fri Jul 1 16:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:28:34.181026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0fc57-7c82-4953-a188-8fb892d1201d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:34.181515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0fc57-7c82-4953-a188-8fb892d1201d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:34.181615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0fc57-7c82-4953-a188-8fb892d1201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:34.202387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e4d0fc57-7c82-4953-a188-8fb892d1201d None None] MFA Rules not processed for user `eb3ded7163fa400399d1b09079a366ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:34.203581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e4d0fc57-7c82-4953-a188-8fb892d1201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:34.213920 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 762/1520] 10.222.0.59 () {58 vars in 1057 bytes} [Fri Jul 1 16:28:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:28:34.221541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8f983-2e5b-4a27-88c1-812c00b4e5a2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:28:34.236686 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8f983-2e5b-4a27-88c1-812c00b4e5a2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:28:34.242155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5abdd-4079-4fd2-baa6-280dcfa0859a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:28:34.242766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5abdd-4079-4fd2-baa6-280dcfa0859a service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:34.243052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5abdd-4079-4fd2-baa6-280dcfa0859a service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:34.243329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5abdd-4079-4fd2-baa6-280dcfa0859a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:34.251921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5abdd-4079-4fd2-baa6-280dcfa0859a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:28:34.253548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5abdd-4079-4fd2-baa6-280dcfa0859a service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:28:34.263278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 759/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:28:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:28:36.127433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d91b-8980-4535-ad23-f90aad5dab09 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:36.128924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d91b-8980-4535-ad23-f90aad5dab09 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:36.129322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d91b-8980-4535-ad23-f90aad5dab09 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:36.132724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:28:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:28:36.138778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e591-434b-417b-897c-2a7ace70f92f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:36.139557 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e591-434b-417b-897c-2a7ace70f92f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:36.139749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330e591-434b-417b-897c-2a7ace70f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:36.160889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a330e591-434b-417b-897c-2a7ace70f92f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:36.162073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a330e591-434b-417b-897c-2a7ace70f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:36.170951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:28:36.326864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81d91b-8980-4535-ad23-f90aad5dab09 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:28:36.344274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81d91b-8980-4535-ad23-f90aad5dab09 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:28:36.350968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b44ec-3d19-4439-8cfe-d30f0f2dd470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:28:36.351615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b44ec-3d19-4439-8cfe-d30f0f2dd470 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:36.351896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b44ec-3d19-4439-8cfe-d30f0f2dd470 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:36.352174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b44ec-3d19-4439-8cfe-d30f0f2dd470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:36.360656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b44ec-3d19-4439-8cfe-d30f0f2dd470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:28:36.362327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b44ec-3d19-4439-8cfe-d30f0f2dd470 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:28:36.372016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 764/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:28:37.198188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618c859-fe69-4b8a-be50-be0172ac8487 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:37.199105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618c859-fe69-4b8a-be50-be0172ac8487 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:37.199105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618c859-fe69-4b8a-be50-be0172ac8487 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:37.201775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 1 16:28:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:28:37.207689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73792-4e7e-40c3-b10e-6f50302572a5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:37.208154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73792-4e7e-40c3-b10e-6f50302572a5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:37.208255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73792-4e7e-40c3-b10e-6f50302572a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:37.227647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-44d73792-4e7e-40c3-b10e-6f50302572a5 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:37.228833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-44d73792-4e7e-40c3-b10e-6f50302572a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:37.237624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 1 16:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:28:37.399386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618c859-fe69-4b8a-be50-be0172ac8487 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:28:37.423960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618c859-fe69-4b8a-be50-be0172ac8487 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:28:37.430619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ab91a-d99a-421b-bba1-c4e074675637 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:28:37.431259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab91a-d99a-421b-bba1-c4e074675637 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:37.431543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab91a-d99a-421b-bba1-c4e074675637 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:37.431793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ab91a-d99a-421b-bba1-c4e074675637 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:37.440487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ab91a-d99a-421b-bba1-c4e074675637 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:28:37.442157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ab91a-d99a-421b-bba1-c4e074675637 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:28:37.451695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 762/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:28:41.483341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027504b8-d895-494f-ab8b-9f0eab55ab82 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:41.484011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027504b8-d895-494f-ab8b-9f0eab55ab82 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:41.484011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027504b8-d895-494f-ab8b-9f0eab55ab82 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:41.485352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:28:41.491907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186e6fa-e319-4bbe-9886-5308f1375585 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:41.492347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186e6fa-e319-4bbe-9886-5308f1375585 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:41.492578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186e6fa-e319-4bbe-9886-5308f1375585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:41.517595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4186e6fa-e319-4bbe-9886-5308f1375585 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:41.518829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4186e6fa-e319-4bbe-9886-5308f1375585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:41.527583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:28:41.566000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027504b8-d895-494f-ab8b-9f0eab55ab82 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:28:41.567754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-027504b8-d895-494f-ab8b-9f0eab55ab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:41.630176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027504b8-d895-494f-ab8b-9f0eab55ab82 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:28:41.634052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa13ea-0b30-4773-95af-50856b706478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:28:41.634704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa13ea-0b30-4773-95af-50856b706478 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:41.634989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa13ea-0b30-4773-95af-50856b706478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:41.635266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa13ea-0b30-4773-95af-50856b706478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:41.645532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa13ea-0b30-4773-95af-50856b706478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:28:41.646986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa13ea-0b30-4773-95af-50856b706478 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:28:41.652175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:28:41.657912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 767/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:28:43.687863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92b1cb-7316-4e35-a828-96fa726be480 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:43.688464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92b1cb-7316-4e35-a828-96fa726be480 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:43.688464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92b1cb-7316-4e35-a828-96fa726be480 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:43.690653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:28:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:28:43.696729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86493-4b82-4e21-9e02-95cd55610ea4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:43.697234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86493-4b82-4e21-9e02-95cd55610ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:43.697331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86493-4b82-4e21-9e02-95cd55610ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:43.725413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-31d86493-4b82-4e21-9e02-95cd55610ea4 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:43.726647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-31d86493-4b82-4e21-9e02-95cd55610ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:43.735455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:28:43.773316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92b1cb-7316-4e35-a828-96fa726be480 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:28:43.775286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6d92b1cb-7316-4e35-a828-96fa726be480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:43.784226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=56 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:28:43.791138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92b1cb-7316-4e35-a828-96fa726be480 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:28:43.795046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f9ea-8361-4e29-8e6b-00296807c2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:28:43.795692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f9ea-8361-4e29-8e6b-00296807c2ff service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:43.795985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f9ea-8361-4e29-8e6b-00296807c2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:43.796261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f9ea-8361-4e29-8e6b-00296807c2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:43.805798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7f9ea-8361-4e29-8e6b-00296807c2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:28:43.807262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7f9ea-8361-4e29-8e6b-00296807c2ff service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:28:43.817268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 765/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:28:47.562553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e675222-2fb1-4113-bbe9-879b12163f98 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:47.563154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e675222-2fb1-4113-bbe9-879b12163f98 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:47.563311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e675222-2fb1-4113-bbe9-879b12163f98 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:47.565181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:28:47.571664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cdd2c-d31f-40e7-8f29-f75f77dc9e6c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:47.572128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cdd2c-d31f-40e7-8f29-f75f77dc9e6c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:47.572508 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cdd2c-d31f-40e7-8f29-f75f77dc9e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:47.593237 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f54cdd2c-d31f-40e7-8f29-f75f77dc9e6c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:47.594489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f54cdd2c-d31f-40e7-8f29-f75f77dc9e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:47.603274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:28:47.903269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e675222-2fb1-4113-bbe9-879b12163f98 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:28:47.906219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8e675222-2fb1-4113-bbe9-879b12163f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:47.976546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e675222-2fb1-4113-bbe9-879b12163f98 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:28:47.980837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613a1a2-c00f-4562-8628-0c2accbfa586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:28:47.981503 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613a1a2-c00f-4562-8628-0c2accbfa586 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:47.981783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613a1a2-c00f-4562-8628-0c2accbfa586 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:47.982056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613a1a2-c00f-4562-8628-0c2accbfa586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:47.991816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613a1a2-c00f-4562-8628-0c2accbfa586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:28:47.993307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613a1a2-c00f-4562-8628-0c2accbfa586 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:28:48.002690 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 770/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:28:50.052371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ca3bf-9261-424c-a745-8034cc8b8dec None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:50.053226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ca3bf-9261-424c-a745-8034cc8b8dec None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:50.053226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ca3bf-9261-424c-a745-8034cc8b8dec None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:50.055152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 1 16:28:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:28:50.060743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29fa5b-bab8-479a-aeff-c8946a051e4c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:50.061719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29fa5b-bab8-479a-aeff-c8946a051e4c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:50.061903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29fa5b-bab8-479a-aeff-c8946a051e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:50.082722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fc29fa5b-bab8-479a-aeff-c8946a051e4c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:28:50.083936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fc29fa5b-bab8-479a-aeff-c8946a051e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:50.092934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 1 16:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:28:50.390951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ca3bf-9261-424c-a745-8034cc8b8dec None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:28:50.393043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-071ca3bf-9261-424c-a745-8034cc8b8dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:28:50.407242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ca3bf-9261-424c-a745-8034cc8b8dec None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:28:50.411013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2b7b5-5f5f-4e93-bc4e-409f8b2b3adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:28:50.411655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b7b5-5f5f-4e93-bc4e-409f8b2b3adf service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:28:50.411934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b7b5-5f5f-4e93-bc4e-409f8b2b3adf service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:28:50.412208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b7b5-5f5f-4e93-bc4e-409f8b2b3adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:28:50.421486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2b7b5-5f5f-4e93-bc4e-409f8b2b3adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:28:50.422926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2b7b5-5f5f-4e93-bc4e-409f8b2b3adf service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:28:50.432563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 768/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:29:00.075599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=32 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:29:00.428541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=14 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:21.561290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebbc47-a372-42b2-970f-7f5d95ac4dc5 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:21.561290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebbc47-a372-42b2-970f-7f5d95ac4dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:21.562092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebbc47-a372-42b2-970f-7f5d95ac4dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:21.587281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cbebbc47-a372-42b2-970f-7f5d95ac4dc5 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:21.588540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cbebbc47-a372-42b2-970f-7f5d95ac4dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:21.603184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 772/1540] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:21.613148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d07d0-5ad5-48e7-9436-3e954092706f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:21.613785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d07d0-5ad5-48e7-9436-3e954092706f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:21.613785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d07d0-5ad5-48e7-9436-3e954092706f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:21.658611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-831d07d0-5ad5-48e7-9436-3e954092706f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:21.660269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-831d07d0-5ad5-48e7-9436-3e954092706f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:21.677705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 769/1541] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:21.683247 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebbc47-a372-42b2-970f-7f5d95ac4dc5 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:21.708265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebbc47-a372-42b2-970f-7f5d95ac4dc5 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:21.714506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad79a3-228d-4666-b2bf-4666ceba3f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:21.715217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad79a3-228d-4666-b2bf-4666ceba3f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:21.715501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad79a3-228d-4666-b2bf-4666ceba3f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:21.715778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad79a3-228d-4666-b2bf-4666ceba3f01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:21.716552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad79a3-228d-4666-b2bf-4666ceba3f01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:21.716884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad79a3-228d-4666-b2bf-4666ceba3f01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:21.723463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad79a3-228d-4666-b2bf-4666ceba3f01 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:21.759470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 773/1542] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:21.768108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d07d0-5ad5-48e7-9436-3e954092706f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:21.782660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d07d0-5ad5-48e7-9436-3e954092706f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:21.793424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f0209-32a9-447b-b05d-38b4a6fdf359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:21.794474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f0209-32a9-447b-b05d-38b4a6fdf359 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:21.794968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f0209-32a9-447b-b05d-38b4a6fdf359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:21.795453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f0209-32a9-447b-b05d-38b4a6fdf359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:21.796369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f0209-32a9-447b-b05d-38b4a6fdf359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:21.798844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f0209-32a9-447b-b05d-38b4a6fdf359 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:21.856405 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 770/1543] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:21 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:21.864274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad79a3-228d-4666-b2bf-4666ceba3f01 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:21.887624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad79a3-228d-4666-b2bf-4666ceba3f01 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:21.962056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000124f0-193d-4a50-b847-0b4bb850cb60 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:21.962720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000124f0-193d-4a50-b847-0b4bb850cb60 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:21.963208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000124f0-193d-4a50-b847-0b4bb850cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:21.998550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-000124f0-193d-4a50-b847-0b4bb850cb60 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:21.998875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b782e3f-4ef9-46dd-bcff-e74e957e690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:21.999438 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b782e3f-4ef9-46dd-bcff-e74e957e690c admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:21.999797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b782e3f-4ef9-46dd-bcff-e74e957e690c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.000059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b782e3f-4ef9-46dd-bcff-e74e957e690c admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.000775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b782e3f-4ef9-46dd-bcff-e74e957e690c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.002209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-000124f0-193d-4a50-b847-0b4bb850cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.007492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b782e3f-4ef9-46dd-bcff-e74e957e690c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.015520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 771/1544] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.017325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14382a12-80f1-4a9b-ab50-894254b8f4fe None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.017837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14382a12-80f1-4a9b-ab50-894254b8f4fe None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.018379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14382a12-80f1-4a9b-ab50-894254b8f4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.053537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-14382a12-80f1-4a9b-ab50-894254b8f4fe None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.055248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-14382a12-80f1-4a9b-ab50-894254b8f4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.061322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 774/1545] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:21 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:22.062658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f62ce-bdbb-41b1-b81a-bddf64e411b7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.063823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f62ce-bdbb-41b1-b81a-bddf64e411b7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.063823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f62ce-bdbb-41b1-b81a-bddf64e411b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.096401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 772/1546] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.097661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14382a12-80f1-4a9b-ab50-894254b8f4fe None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.109490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-756f62ce-bdbb-41b1-b81a-bddf64e411b7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.110707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-756f62ce-bdbb-41b1-b81a-bddf64e411b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.123156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14382a12-80f1-4a9b-ab50-894254b8f4fe None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.131505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 775/1547] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.132536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb85904-c76f-4aa7-acb9-4681cfb97178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.133260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85904-c76f-4aa7-acb9-4681cfb97178 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.133546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85904-c76f-4aa7-acb9-4681cfb97178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.133825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb85904-c76f-4aa7-acb9-4681cfb97178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.135164 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5515-5256-48e8-9948-abab63fdbe24 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.135448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5515-5256-48e8-9948-abab63fdbe24 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.135720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a5515-5256-48e8-9948-abab63fdbe24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.136248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb85904-c76f-4aa7-acb9-4681cfb97178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.139455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb85904-c76f-4aa7-acb9-4681cfb97178 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.151980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 773/1548] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:22.153891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04777d7c-474e-4903-876f-eec23f8a439c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.154401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04777d7c-474e-4903-876f-eec23f8a439c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.154886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04777d7c-474e-4903-876f-eec23f8a439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.158762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-824a5515-5256-48e8-9948-abab63fdbe24 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.159981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-824a5515-5256-48e8-9948-abab63fdbe24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.175048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 776/1549] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.176594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f52f-cbde-44f4-af68-4089c2d7b41b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.176915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f52f-cbde-44f4-af68-4089c2d7b41b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.177195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f52f-cbde-44f4-af68-4089c2d7b41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.182782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-04777d7c-474e-4903-876f-eec23f8a439c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.184242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-04777d7c-474e-4903-876f-eec23f8a439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.192416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 774/1550] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.195319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04777d7c-474e-4903-876f-eec23f8a439c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.195856 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f760f52f-cbde-44f4-af68-4089c2d7b41b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.199183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f760f52f-cbde-44f4-af68-4089c2d7b41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.205700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04777d7c-474e-4903-876f-eec23f8a439c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.207541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 777/1551] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.208654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc3b42-2854-44e5-a0c2-e2542ed309bb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.208971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc3b42-2854-44e5-a0c2-e2542ed309bb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.209406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc3b42-2854-44e5-a0c2-e2542ed309bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.217798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b62a9-9476-42c1-b4ff-f46f41f1d1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.218931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b62a9-9476-42c1-b4ff-f46f41f1d1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.219422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b62a9-9476-42c1-b4ff-f46f41f1d1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.219898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b62a9-9476-42c1-b4ff-f46f41f1d1ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.221482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b62a9-9476-42c1-b4ff-f46f41f1d1ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:22.222002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b62a9-9476-42c1-b4ff-f46f41f1d1ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.223934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-bd7b62a9-9476-42c1-b4ff-f46f41f1d1ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:30:22.223934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: warnings.warn(msg) Jul 01 16:30:22.223934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: Jul 01 16:30:22.225500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b62a9-9476-42c1-b4ff-f46f41f1d1ce admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.228286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4acc3b42-2854-44e5-a0c2-e2542ed309bb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.229510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4acc3b42-2854-44e5-a0c2-e2542ed309bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.237604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 778/1552] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.238226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc3b42-2854-44e5-a0c2-e2542ed309bb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.247349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 775/1553] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:22.247530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc3b42-2854-44e5-a0c2-e2542ed309bb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.249685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9e19d-8b5f-4991-80fc-6243a34fb1bf None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.250442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9e19d-8b5f-4991-80fc-6243a34fb1bf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.251332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9e19d-8b5f-4991-80fc-6243a34fb1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.252346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db145f-ff53-4052-8cd3-25b954b2c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.253174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db145f-ff53-4052-8cd3-25b954b2c6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.253455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db145f-ff53-4052-8cd3-25b954b2c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.253729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db145f-ff53-4052-8cd3-25b954b2c6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.254468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db145f-ff53-4052-8cd3-25b954b2c6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.256345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db145f-ff53-4052-8cd3-25b954b2c6f0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.268716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 779/1554] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:22.269606 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db145f-ff53-4052-8cd3-25b954b2c6f0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.276588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-12d9e19d-8b5f-4991-80fc-6243a34fb1bf None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.277923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-12d9e19d-8b5f-4991-80fc-6243a34fb1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.284148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db145f-ff53-4052-8cd3-25b954b2c6f0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.288764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6638d-ca7a-40fe-b043-f5d5dc036f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.289565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6638d-ca7a-40fe-b043-f5d5dc036f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.289942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6638d-ca7a-40fe-b043-f5d5dc036f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.290311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 776/1555] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.291401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1f5ab-ac24-4c03-a2f0-e6b8fbcfa3f7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.291683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1f5ab-ac24-4c03-a2f0-e6b8fbcfa3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.291960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1f5ab-ac24-4c03-a2f0-e6b8fbcfa3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.293476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6638d-ca7a-40fe-b043-f5d5dc036f9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.294644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6638d-ca7a-40fe-b043-f5d5dc036f9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:22.295201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6638d-ca7a-40fe-b043-f5d5dc036f9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.297863 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6638d-ca7a-40fe-b043-f5d5dc036f9a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.316707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 780/1556] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:22.316707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80947-875c-4c1d-a9b3-0611597effcb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.316707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80947-875c-4c1d-a9b3-0611597effcb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.316707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80947-875c-4c1d-a9b3-0611597effcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.318391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4aa1f5ab-ac24-4c03-a2f0-e6b8fbcfa3f7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.319670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4aa1f5ab-ac24-4c03-a2f0-e6b8fbcfa3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.327569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 777/1557] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.329087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c86bd2-7b1e-430a-a4b4-de2b8ef2006b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.329454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c86bd2-7b1e-430a-a4b4-de2b8ef2006b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.329791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c86bd2-7b1e-430a-a4b4-de2b8ef2006b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.339877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bdb80947-875c-4c1d-a9b3-0611597effcb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.341105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bdb80947-875c-4c1d-a9b3-0611597effcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.348663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b2c86bd2-7b1e-430a-a4b4-de2b8ef2006b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.349935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 781/1558] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.350727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb80947-875c-4c1d-a9b3-0611597effcb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.350845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b2c86bd2-7b1e-430a-a4b4-de2b8ef2006b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.359912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 778/1559] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.360645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c86bd2-7b1e-430a-a4b4-de2b8ef2006b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.361092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb80947-875c-4c1d-a9b3-0611597effcb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.365755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc675f-930d-4b29-b39c-c5a7579e694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.366558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc675f-930d-4b29-b39c-c5a7579e694b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.366899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc675f-930d-4b29-b39c-c5a7579e694b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.367247 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc675f-930d-4b29-b39c-c5a7579e694b admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.368008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc675f-930d-4b29-b39c-c5a7579e694b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.369408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-3bcc675f-930d-4b29-b39c-c5a7579e694b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:30:22.369408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: warnings.warn(msg) Jul 01 16:30:22.369408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: Jul 01 16:30:22.370608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc675f-930d-4b29-b39c-c5a7579e694b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.370711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c86bd2-7b1e-430a-a4b4-de2b8ef2006b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.375496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b894dda-4423-4da2-a69a-e828240c76d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.376367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b894dda-4423-4da2-a69a-e828240c76d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.376643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b894dda-4423-4da2-a69a-e828240c76d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.376945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b894dda-4423-4da2-a69a-e828240c76d1 admin admin] PATH_INFO: `/v3/projects/198dc2d330dc4d4fa06a230ddef76ea1/users/23265f35b4c44341b9bca85b613f56af/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.394472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b894dda-4423-4da2-a69a-e828240c76d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198dc2d330dc4d4fa06a230ddef76ea1, user_id=23265f35b4c44341b9bca85b613f56af, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.397147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b894dda-4423-4da2-a69a-e828240c76d1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.403782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 782/1560] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:22.403782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a9895-86a7-4089-b071-2391e52a2811 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.403782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a9895-86a7-4089-b071-2391e52a2811 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.403782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a9895-86a7-4089-b071-2391e52a2811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.411637 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 779/1561] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:22 2022] PUT /identity/v3/projects/198dc2d330dc4d4fa06a230ddef76ea1/users/23265f35b4c44341b9bca85b613f56af/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:22.413793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b8943-ea93-40c3-9bc5-8359d099f929 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.413793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b8943-ea93-40c3-9bc5-8359d099f929 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.413793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b8943-ea93-40c3-9bc5-8359d099f929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.425492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fa7a9895-86a7-4089-b071-2391e52a2811 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.426693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fa7a9895-86a7-4089-b071-2391e52a2811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.430990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5b5b8943-ea93-40c3-9bc5-8359d099f929 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.432161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5b5b8943-ea93-40c3-9bc5-8359d099f929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.470475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:22.487097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 783/1562] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.487918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a9895-86a7-4089-b071-2391e52a2811 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.492903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 780/1563] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.492903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b8943-ea93-40c3-9bc5-8359d099f929 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.498835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a9895-86a7-4089-b071-2391e52a2811 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.502318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b8943-ea93-40c3-9bc5-8359d099f929 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.504624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0130-5399-4f16-b575-9ec7da98d73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.505367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0130-5399-4f16-b575-9ec7da98d73f admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.505644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0130-5399-4f16-b575-9ec7da98d73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.505915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0130-5399-4f16-b575-9ec7da98d73f admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.506643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd0130-5399-4f16-b575-9ec7da98d73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.506984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17e04a-392d-42ea-8b60-2844cf15eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.507619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17e04a-392d-42ea-8b60-2844cf15eb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.507899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17e04a-392d-42ea-8b60-2844cf15eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.508169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17e04a-392d-42ea-8b60-2844cf15eb1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.508568 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd0130-5399-4f16-b575-9ec7da98d73f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.508918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17e04a-392d-42ea-8b60-2844cf15eb1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:22.509223 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17e04a-392d-42ea-8b60-2844cf15eb1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.510823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df17e04a-392d-42ea-8b60-2844cf15eb1a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.526724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 781/1564] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:22.527664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17e04a-392d-42ea-8b60-2844cf15eb1a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.536711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 784/1565] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:22.537885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0130-5399-4f16-b575-9ec7da98d73f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.545016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17e04a-392d-42ea-8b60-2844cf15eb1a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.574777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:22.600516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0130-5399-4f16-b575-9ec7da98d73f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.605521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdcc2b-7744-4fcc-b3ac-578d9e315b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.606186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdcc2b-7744-4fcc-b3ac-578d9e315b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.606304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641b6ab-66c6-4352-8071-a63f4f000294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.606465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdcc2b-7744-4fcc-b3ac-578d9e315b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.608322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fdcc2b-7744-4fcc-b3ac-578d9e315b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.608440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b6ab-66c6-4352-8071-a63f4f000294 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.608440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b6ab-66c6-4352-8071-a63f4f000294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.608629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdcc2b-7744-4fcc-b3ac-578d9e315b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:22.608707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b6ab-66c6-4352-8071-a63f4f000294 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.608779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdcc2b-7744-4fcc-b3ac-578d9e315b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.608888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b6ab-66c6-4352-8071-a63f4f000294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:22.608888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b6ab-66c6-4352-8071-a63f4f000294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.609628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fdcc2b-7744-4fcc-b3ac-578d9e315b52 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.610563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b6ab-66c6-4352-8071-a63f4f000294 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.628953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 785/1566] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:22.629178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 782/1567] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:22.629650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdcc2b-7744-4fcc-b3ac-578d9e315b52 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.629770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ac50-c018-4a8a-a02c-fa0a908d9993 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.629770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ac50-c018-4a8a-a02c-fa0a908d9993 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.629770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961ac50-c018-4a8a-a02c-fa0a908d9993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.638799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fdcc2b-7744-4fcc-b3ac-578d9e315b52 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.643485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdfde6-d789-4194-bcfe-e527210d5a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.644203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdfde6-d789-4194-bcfe-e527210d5a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.644480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdfde6-d789-4194-bcfe-e527210d5a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.644776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdfde6-d789-4194-bcfe-e527210d5a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.645494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdfde6-d789-4194-bcfe-e527210d5a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.645738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a961ac50-c018-4a8a-a02c-fa0a908d9993 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.646964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a961ac50-c018-4a8a-a02c-fa0a908d9993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.647548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdfde6-d789-4194-bcfe-e527210d5a30 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.654570 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 783/1568] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.655347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ac50-c018-4a8a-a02c-fa0a908d9993 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.665309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961ac50-c018-4a8a-a02c-fa0a908d9993 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.670457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87603107-390c-47b9-8a91-4c97fd7a4ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.671191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87603107-390c-47b9-8a91-4c97fd7a4ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.671483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87603107-390c-47b9-8a91-4c97fd7a4ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.671774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87603107-390c-47b9-8a91-4c97fd7a4ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.672567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87603107-390c-47b9-8a91-4c97fd7a4ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:22.672934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87603107-390c-47b9-8a91-4c97fd7a4ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.674584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87603107-390c-47b9-8a91-4c97fd7a4ffe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.678033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 786/1569] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/users => generated 283 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:22.682585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79c53-9e8d-43d2-9dea-c3952a2e19da None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.683055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79c53-9e8d-43d2-9dea-c3952a2e19da None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.683331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea79c53-9e8d-43d2-9dea-c3952a2e19da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.692124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 784/1570] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:22.692124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87603107-390c-47b9-8a91-4c97fd7a4ffe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.702052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87603107-390c-47b9-8a91-4c97fd7a4ffe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.706920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dc7bb-5b4d-46a5-a803-4de0aa10b8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.707586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dc7bb-5b4d-46a5-a803-4de0aa10b8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.707874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dc7bb-5b4d-46a5-a803-4de0aa10b8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.708148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547dc7bb-5b4d-46a5-a803-4de0aa10b8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.708838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dc7bb-5b4d-46a5-a803-4de0aa10b8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.709095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4ea79c53-9e8d-43d2-9dea-c3952a2e19da None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:22.710400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4ea79c53-9e8d-43d2-9dea-c3952a2e19da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:22.711675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547dc7bb-5b4d-46a5-a803-4de0aa10b8ff admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.719944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 787/1571] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:22.721097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79c53-9e8d-43d2-9dea-c3952a2e19da None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.731585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea79c53-9e8d-43d2-9dea-c3952a2e19da None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.736638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03339dc3-2335-491a-985d-7d66fe7c8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.737449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03339dc3-2335-491a-985d-7d66fe7c8736 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.737737 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03339dc3-2335-491a-985d-7d66fe7c8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.738010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03339dc3-2335-491a-985d-7d66fe7c8736 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.738700 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03339dc3-2335-491a-985d-7d66fe7c8736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.744264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03339dc3-2335-491a-985d-7d66fe7c8736 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.744415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 785/1572] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:22.744415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dc7bb-5b4d-46a5-a803-4de0aa10b8ff admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.772834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 788/1573] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:22.772834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03339dc3-2335-491a-985d-7d66fe7c8736 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.780617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03339dc3-2335-491a-985d-7d66fe7c8736 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.806279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547dc7bb-5b4d-46a5-a803-4de0aa10b8ff admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.810743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e5fba-4505-4b56-8e3c-611b5f525b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.811402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e5fba-4505-4b56-8e3c-611b5f525b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.811683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e5fba-4505-4b56-8e3c-611b5f525b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.811956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e5fba-4505-4b56-8e3c-611b5f525b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.812695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e5fba-4505-4b56-8e3c-611b5f525b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.814993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e5fba-4505-4b56-8e3c-611b5f525b29 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.837635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af1a08-d37a-4b34-bfff-abec947d3f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.838378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af1a08-d37a-4b34-bfff-abec947d3f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.838661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af1a08-d37a-4b34-bfff-abec947d3f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.838969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af1a08-d37a-4b34-bfff-abec947d3f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.839697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af1a08-d37a-4b34-bfff-abec947d3f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.841676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af1a08-d37a-4b34-bfff-abec947d3f0b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.843716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 786/1574] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:22.844784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e5fba-4505-4b56-8e3c-611b5f525b29 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.871773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 789/1575] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:22.872450 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af1a08-d37a-4b34-bfff-abec947d3f0b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.880680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:22.901080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e5fba-4505-4b56-8e3c-611b5f525b29 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.921278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:22.935066 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af1a08-d37a-4b34-bfff-abec947d3f0b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.940241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a42d3-6984-4964-bc79-73f11d9762ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.940990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a42d3-6984-4964-bc79-73f11d9762ea admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.941293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a42d3-6984-4964-bc79-73f11d9762ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.941565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a42d3-6984-4964-bc79-73f11d9762ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.942292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a42d3-6984-4964-bc79-73f11d9762ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.943903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a42d3-6984-4964-bc79-73f11d9762ea admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.953818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 790/1576] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:22.957712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3da73d-14ee-4f8b-895b-b93a2e301055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.957937 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a42d3-6984-4964-bc79-73f11d9762ea admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.958115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3da73d-14ee-4f8b-895b-b93a2e301055 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.958115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3da73d-14ee-4f8b-895b-b93a2e301055 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.958115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3da73d-14ee-4f8b-895b-b93a2e301055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.964352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a42d3-6984-4964-bc79-73f11d9762ea admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.964899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3da73d-14ee-4f8b-895b-b93a2e301055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.966367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3da73d-14ee-4f8b-895b-b93a2e301055 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.969276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b81d9f-a184-4c80-9da8-2217d3a01a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.970093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81d9f-a184-4c80-9da8-2217d3a01a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.970372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81d9f-a184-4c80-9da8-2217d3a01a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.970646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b81d9f-a184-4c80-9da8-2217d3a01a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.971644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b81d9f-a184-4c80-9da8-2217d3a01a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.973560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b81d9f-a184-4c80-9da8-2217d3a01a09 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:22.976664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 787/1577] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:22.977501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3da73d-14ee-4f8b-895b-b93a2e301055 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:22.987084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3da73d-14ee-4f8b-895b-b93a2e301055 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:22.992150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a04b-1712-45c8-9676-759c25f42d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:22.992933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a04b-1712-45c8-9676-759c25f42d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:22.993246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a04b-1712-45c8-9676-759c25f42d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:22.993559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a04b-1712-45c8-9676-759c25f42d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:22.994372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227a04b-1712-45c8-9676-759c25f42d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:22.994737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227a04b-1712-45c8-9676-759c25f42d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:22.996571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227a04b-1712-45c8-9676-759c25f42d08 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.016756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 788/1578] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:23.018135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 791/1579] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:22 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:23.018226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a04b-1712-45c8-9676-759c25f42d08 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.018311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b81d9f-a184-4c80-9da8-2217d3a01a09 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.036169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a04b-1712-45c8-9676-759c25f42d08 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.104416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d2039-2672-4a8d-9cee-abab516b3d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.105255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2039-2672-4a8d-9cee-abab516b3d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.105600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2039-2672-4a8d-9cee-abab516b3d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.105938 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2039-2672-4a8d-9cee-abab516b3d54 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.106821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d2039-2672-4a8d-9cee-abab516b3d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.107252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b81d9f-a184-4c80-9da8-2217d3a01a09 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.107970 dv-cinder-844961-1-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-644d2039-2672-4a8d-9cee-abab516b3d54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:30:23.107970 dv-cinder-844961-1-smb devstack@keystone.service[80131]: warnings.warn(msg) Jul 01 16:30:23.107970 dv-cinder-844961-1-smb devstack@keystone.service[80131]: Jul 01 16:30:23.109484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d2039-2672-4a8d-9cee-abab516b3d54 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.112385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ff5ab-3f50-4301-ad94-c58dd469db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.113122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ff5ab-3f50-4301-ad94-c58dd469db27 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.113487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ff5ab-3f50-4301-ad94-c58dd469db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.113720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ff5ab-3f50-4301-ad94-c58dd469db27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.114528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ff5ab-3f50-4301-ad94-c58dd469db27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.116071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ff5ab-3f50-4301-ad94-c58dd469db27 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.131662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 792/1580] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.131662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ff5ab-3f50-4301-ad94-c58dd469db27 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.136220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 789/1581] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:23 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:23.137114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d2039-2672-4a8d-9cee-abab516b3d54 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.142593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ff5ab-3f50-4301-ad94-c58dd469db27 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.152105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712b6c-37ed-4925-ac26-cbd3e15881a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.152474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d2039-2672-4a8d-9cee-abab516b3d54 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.152978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712b6c-37ed-4925-ac26-cbd3e15881a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.153263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712b6c-37ed-4925-ac26-cbd3e15881a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.153539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6712b6c-37ed-4925-ac26-cbd3e15881a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.154247 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712b6c-37ed-4925-ac26-cbd3e15881a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.156429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6712b6c-37ed-4925-ac26-cbd3e15881a6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.157640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f2877-caf9-45d6-ae61-e3716056b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.158318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f2877-caf9-45d6-ae61-e3716056b22e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.158609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f2877-caf9-45d6-ae61-e3716056b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.158885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f2877-caf9-45d6-ae61-e3716056b22e admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.159585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f2877-caf9-45d6-ae61-e3716056b22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.161918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f2877-caf9-45d6-ae61-e3716056b22e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.184162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 793/1582] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:23 2022] POST /identity/v3/users => generated 302 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:23.184162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712b6c-37ed-4925-ac26-cbd3e15881a6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.185006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 790/1583] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:23 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:23.186190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f2877-caf9-45d6-ae61-e3716056b22e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.195590 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6712b6c-37ed-4925-ac26-cbd3e15881a6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.197275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f2877-caf9-45d6-ae61-e3716056b22e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.200643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f48ca-9bf6-458b-a88a-ba1e0870b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.201591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f48ca-9bf6-458b-a88a-ba1e0870b626 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.201896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cd8c0-91e8-4888-979b-4a9e2bacba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.202033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f48ca-9bf6-458b-a88a-ba1e0870b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.202444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f48ca-9bf6-458b-a88a-ba1e0870b626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.202733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cd8c0-91e8-4888-979b-4a9e2bacba19 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.203086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cd8c0-91e8-4888-979b-4a9e2bacba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.203367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cd8c0-91e8-4888-979b-4a9e2bacba19 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.203637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f48ca-9bf6-458b-a88a-ba1e0870b626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.204056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cd8c0-91e8-4888-979b-4a9e2bacba19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.205647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f48ca-9bf6-458b-a88a-ba1e0870b626 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.206066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cd8c0-91e8-4888-979b-4a9e2bacba19 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.219471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 794/1584] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.222986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f48ca-9bf6-458b-a88a-ba1e0870b626 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.238360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 791/1585] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:23 2022] POST /identity/v3/users => generated 297 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:23.238877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f48ca-9bf6-458b-a88a-ba1e0870b626 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.239725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cd8c0-91e8-4888-979b-4a9e2bacba19 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.244491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3f6b6-752b-4fac-a8c8-1e8ff9f17938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.247051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3f6b6-752b-4fac-a8c8-1e8ff9f17938 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.248552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3f6b6-752b-4fac-a8c8-1e8ff9f17938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.248552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3f6b6-752b-4fac-a8c8-1e8ff9f17938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.249557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3f6b6-752b-4fac-a8c8-1e8ff9f17938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.251377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af3f6b6-752b-4fac-a8c8-1e8ff9f17938 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.251746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cd8c0-91e8-4888-979b-4a9e2bacba19 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.257062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f1ed9-9c90-47cb-9160-fd9b5b73a705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.258101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f1ed9-9c90-47cb-9160-fd9b5b73a705 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.258386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f1ed9-9c90-47cb-9160-fd9b5b73a705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.258662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f1ed9-9c90-47cb-9160-fd9b5b73a705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.259890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f1ed9-9c90-47cb-9160-fd9b5b73a705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.261546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f1ed9-9c90-47cb-9160-fd9b5b73a705 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.277009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 792/1586] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.277009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f1ed9-9c90-47cb-9160-fd9b5b73a705 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.288834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f1ed9-9c90-47cb-9160-fd9b5b73a705 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.292042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 795/1587] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:23 2022] POST /identity/v3/projects => generated 389 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:23.293107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3f6b6-752b-4fac-a8c8-1e8ff9f17938 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.296461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd788ba1-2abd-4d0e-bcf4-80b731f5f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.297285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd788ba1-2abd-4d0e-bcf4-80b731f5f433 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.298155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd788ba1-2abd-4d0e-bcf4-80b731f5f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.298443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd788ba1-2abd-4d0e-bcf4-80b731f5f433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.299365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd788ba1-2abd-4d0e-bcf4-80b731f5f433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.301220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd788ba1-2abd-4d0e-bcf4-80b731f5f433 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.312426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 793/1588] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.313482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd788ba1-2abd-4d0e-bcf4-80b731f5f433 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.324714 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd788ba1-2abd-4d0e-bcf4-80b731f5f433 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.332498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:23.377954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3f6b6-752b-4fac-a8c8-1e8ff9f17938 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.384359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfea584-24e7-480c-b283-fac989f5c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.384547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:23.385034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfea584-24e7-480c-b283-fac989f5c7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.385312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfea584-24e7-480c-b283-fac989f5c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.385581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfea584-24e7-480c-b283-fac989f5c7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.386378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfea584-24e7-480c-b283-fac989f5c7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.388062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfea584-24e7-480c-b283-fac989f5c7cf admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.403238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 796/1589] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.403238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfea584-24e7-480c-b283-fac989f5c7cf admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.410278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c9d0-b441-4691-a9a9-2b77f9a2eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.411180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c9d0-b441-4691-a9a9-2b77f9a2eeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.411671 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c9d0-b441-4691-a9a9-2b77f9a2eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.412988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61c9d0-b441-4691-a9a9-2b77f9a2eeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.413113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfea584-24e7-480c-b283-fac989f5c7cf admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.417066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61c9d0-b441-4691-a9a9-2b77f9a2eeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.417646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0c22b-2518-4f66-81a1-a128a23fb306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.418533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0c22b-2518-4f66-81a1-a128a23fb306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.418807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0c22b-2518-4f66-81a1-a128a23fb306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.419074 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0c22b-2518-4f66-81a1-a128a23fb306 admin admin] PATH_INFO: `/v3/projects/8b70f74faf984dd5bec5e1b5c4f7d1c2/users/894d34c3c126400fbbef47bb43379ed4/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.419624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61c9d0-b441-4691-a9a9-2b77f9a2eeb1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.439219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 794/1590] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.439219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c9d0-b441-4691-a9a9-2b77f9a2eeb1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.443004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0c22b-2518-4f66-81a1-a128a23fb306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b70f74faf984dd5bec5e1b5c4f7d1c2, user_id=894d34c3c126400fbbef47bb43379ed4, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.444079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-51b0c22b-2518-4f66-81a1-a128a23fb306 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:30:23.444079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: warnings.warn(msg) Jul 01 16:30:23.444079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: Jul 01 16:30:23.446106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0c22b-2518-4f66-81a1-a128a23fb306 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.448017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61c9d0-b441-4691-a9a9-2b77f9a2eeb1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.454747 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25422ff-068a-449a-ba7d-3e3fc0adc126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.455571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25422ff-068a-449a-ba7d-3e3fc0adc126 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.455852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25422ff-068a-449a-ba7d-3e3fc0adc126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.456123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25422ff-068a-449a-ba7d-3e3fc0adc126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.456938 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25422ff-068a-449a-ba7d-3e3fc0adc126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.458642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25422ff-068a-449a-ba7d-3e3fc0adc126 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.465255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 797/1591] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:23 2022] PUT /identity/v3/projects/8b70f74faf984dd5bec5e1b5c4f7d1c2/users/894d34c3c126400fbbef47bb43379ed4/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:23.465978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0c22b-2518-4f66-81a1-a128a23fb306 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.477484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 795/1592] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.477484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25422ff-068a-449a-ba7d-3e3fc0adc126 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.485572 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25422ff-068a-449a-ba7d-3e3fc0adc126 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.542284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0c22b-2518-4f66-81a1-a128a23fb306 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.548567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762ef0d-845e-414b-aa6d-e5e963807d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.549543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762ef0d-845e-414b-aa6d-e5e963807d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.549833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762ef0d-845e-414b-aa6d-e5e963807d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.550114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762ef0d-845e-414b-aa6d-e5e963807d44 admin admin] PATH_INFO: `/v3/projects/f2c0a59053d04aaeb9a8751b76b55deb/users/5d773059c4b34e3e9c19e8355093266f/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.552128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3261a7-d92d-4550-9ae7-18b6c482fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.552993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3261a7-d92d-4550-9ae7-18b6c482fa12 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.553284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3261a7-d92d-4550-9ae7-18b6c482fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.553564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3261a7-d92d-4550-9ae7-18b6c482fa12 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.554263 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3261a7-d92d-4550-9ae7-18b6c482fa12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.556227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3261a7-d92d-4550-9ae7-18b6c482fa12 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.566993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762ef0d-845e-414b-aa6d-e5e963807d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c0a59053d04aaeb9a8751b76b55deb, user_id=5d773059c4b34e3e9c19e8355093266f, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.569909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762ef0d-845e-414b-aa6d-e5e963807d44 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.580350 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 796/1593] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:23 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:23.581740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3261a7-d92d-4550-9ae7-18b6c482fa12 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.585505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 798/1594] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:23 2022] PUT /identity/v3/projects/f2c0a59053d04aaeb9a8751b76b55deb/users/5d773059c4b34e3e9c19e8355093266f/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:23.589933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762ef0d-845e-414b-aa6d-e5e963807d44 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.593677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3261a7-d92d-4550-9ae7-18b6c482fa12 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.660060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe1281-8857-49e7-bb40-a1e4bdca4482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.660858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe1281-8857-49e7-bb40-a1e4bdca4482 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.661739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762ef0d-845e-414b-aa6d-e5e963807d44 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.662105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe1281-8857-49e7-bb40-a1e4bdca4482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.662105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe1281-8857-49e7-bb40-a1e4bdca4482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.662513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe1281-8857-49e7-bb40-a1e4bdca4482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.664330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe1281-8857-49e7-bb40-a1e4bdca4482 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.666258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb45063-1387-4672-a570-8ad94727a616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.666950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb45063-1387-4672-a570-8ad94727a616 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.667228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb45063-1387-4672-a570-8ad94727a616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.667506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb45063-1387-4672-a570-8ad94727a616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.668374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb45063-1387-4672-a570-8ad94727a616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.670017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb45063-1387-4672-a570-8ad94727a616 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.676053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 797/1595] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.676874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe1281-8857-49e7-bb40-a1e4bdca4482 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.684559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 799/1596] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.684559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb45063-1387-4672-a570-8ad94727a616 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.687395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe1281-8857-49e7-bb40-a1e4bdca4482 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.693656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb45063-1387-4672-a570-8ad94727a616 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.696319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3823d-f2f4-4921-bd46-eaf2017f0ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.697028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3823d-f2f4-4921-bd46-eaf2017f0ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.697323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3823d-f2f4-4921-bd46-eaf2017f0ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.697572 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3823d-f2f4-4921-bd46-eaf2017f0ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.698413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3823d-f2f4-4921-bd46-eaf2017f0ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.698731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf5465-2fa0-46df-a894-48529e75c68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.699402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5465-2fa0-46df-a894-48529e75c68e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.699686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5465-2fa0-46df-a894-48529e75c68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.699959 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf5465-2fa0-46df-a894-48529e75c68e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.700532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3823d-f2f4-4921-bd46-eaf2017f0ffd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.700658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf5465-2fa0-46df-a894-48529e75c68e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.702320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf5465-2fa0-46df-a894-48529e75c68e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.715450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 798/1597] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.717031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d1228-8303-4c6e-b167-0e316b5d1fc7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.717546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d1228-8303-4c6e-b167-0e316b5d1fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.717838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d1228-8303-4c6e-b167-0e316b5d1fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.724039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 800/1598] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.724837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf5465-2fa0-46df-a894-48529e75c68e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.751886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf5465-2fa0-46df-a894-48529e75c68e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.758136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77a36b-355b-4b6f-ad72-35fc3f0f74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.758835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a36b-355b-4b6f-ad72-35fc3f0f74ac admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.759113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a36b-355b-4b6f-ad72-35fc3f0f74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.759772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77a36b-355b-4b6f-ad72-35fc3f0f74ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.760110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77a36b-355b-4b6f-ad72-35fc3f0f74ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.761803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77a36b-355b-4b6f-ad72-35fc3f0f74ac admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.764554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:23.767009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ee5d1228-8303-4c6e-b167-0e316b5d1fc7 None None] MFA Rules not processed for user `894d34c3c126400fbbef47bb43379ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:23.768520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ee5d1228-8303-4c6e-b167-0e316b5d1fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:23.779661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 801/1599] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:23.781301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90617d-bb80-4d45-a5e2-3038ab00cdce None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.781595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90617d-bb80-4d45-a5e2-3038ab00cdce None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.781879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90617d-bb80-4d45-a5e2-3038ab00cdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.800799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4a90617d-bb80-4d45-a5e2-3038ab00cdce None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:23.802075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4a90617d-bb80-4d45-a5e2-3038ab00cdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:23.815358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:23.816184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 802/1600] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:23.817178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90617d-bb80-4d45-a5e2-3038ab00cdce None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.830057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90617d-bb80-4d45-a5e2-3038ab00cdce None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.837970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa91571-237d-4d5d-9482-b904346ee1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.838880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa91571-237d-4d5d-9482-b904346ee1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.839153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa91571-237d-4d5d-9482-b904346ee1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.839424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa91571-237d-4d5d-9482-b904346ee1f4 admin admin] PATH_INFO: `/v3/projects/5ae18c4aeaa542a192a303a32cf70dde/users/107013797d654997a149d96e76dd3dea/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.867052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa91571-237d-4d5d-9482-b904346ee1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae18c4aeaa542a192a303a32cf70dde, user_id=107013797d654997a149d96e76dd3dea, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.869624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 799/1601] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:23.870662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa91571-237d-4d5d-9482-b904346ee1f4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.870925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d1228-8303-4c6e-b167-0e316b5d1fc7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.883491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d1228-8303-4c6e-b167-0e316b5d1fc7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:23.903377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 803/1602] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:23 2022] PUT /identity/v3/projects/5ae18c4aeaa542a192a303a32cf70dde/users/107013797d654997a149d96e76dd3dea/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:23.903377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa91571-237d-4d5d-9482-b904346ee1f4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:23.960189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0889eb-f1d5-4a12-9405-a740f0c4777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:23.961275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0889eb-f1d5-4a12-9405-a740f0c4777f admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:23.961557 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0889eb-f1d5-4a12-9405-a740f0c4777f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:23.961882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0889eb-f1d5-4a12-9405-a740f0c4777f admin admin] PATH_INFO: `/v3/projects/99dbcdefb4404fcfbe7b822e9958357d/users/dc08647c12494105a06061aee97e7e47/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:23.978520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0889eb-f1d5-4a12-9405-a740f0c4777f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dbcdefb4404fcfbe7b822e9958357d, user_id=dc08647c12494105a06061aee97e7e47, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:23.981404 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0889eb-f1d5-4a12-9405-a740f0c4777f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:23.996107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa91571-237d-4d5d-9482-b904346ee1f4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:24.000578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 800/1603] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:23 2022] PUT /identity/v3/projects/99dbcdefb4404fcfbe7b822e9958357d/users/dc08647c12494105a06061aee97e7e47/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:24.014550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0889eb-f1d5-4a12-9405-a740f0c4777f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:24.068260 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661e8dc-9342-4f73-9dd8-fbbff228fb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:24.069944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661e8dc-9342-4f73-9dd8-fbbff228fb09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.070234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661e8dc-9342-4f73-9dd8-fbbff228fb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.070514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661e8dc-9342-4f73-9dd8-fbbff228fb09 admin admin] PATH_INFO: `/v3/projects/1fe7d9d8a18a4460b6192e49f28ca4db/users/4bf99018f4784273b748be6e68e1a807/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.091080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0889eb-f1d5-4a12-9405-a740f0c4777f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:24.092450 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661e8dc-9342-4f73-9dd8-fbbff228fb09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe7d9d8a18a4460b6192e49f28ca4db, user_id=4bf99018f4784273b748be6e68e1a807, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:24.096951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf691b-d5e7-430d-9c99-1a4ce85b3bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:24.097109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3661e8dc-9342-4f73-9dd8-fbbff228fb09 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:24.097968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf691b-d5e7-430d-9c99-1a4ce85b3bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.098324 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf691b-d5e7-430d-9c99-1a4ce85b3bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.098669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf691b-d5e7-430d-9c99-1a4ce85b3bca admin admin] PATH_INFO: `/v3/projects/a0b0a1e579274d26a74b1e9ec4241c8f/users/fdc1a110d0924e759024f7cc6fc49738/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.118719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 804/1604] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:23 2022] PUT /identity/v3/projects/1fe7d9d8a18a4460b6192e49f28ca4db/users/4bf99018f4784273b748be6e68e1a807/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:24.120147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661e8dc-9342-4f73-9dd8-fbbff228fb09 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:24.133123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf691b-d5e7-430d-9c99-1a4ce85b3bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b0a1e579274d26a74b1e9ec4241c8f, user_id=fdc1a110d0924e759024f7cc6fc49738, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:24.136167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf691b-d5e7-430d-9c99-1a4ce85b3bca admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:24.156007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 801/1605] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:24 2022] PUT /identity/v3/projects/a0b0a1e579274d26a74b1e9ec4241c8f/users/fdc1a110d0924e759024f7cc6fc49738/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:24.157329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf691b-d5e7-430d-9c99-1a4ce85b3bca admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:24.199452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:24.205660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661e8dc-9342-4f73-9dd8-fbbff228fb09 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:24.242071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:24.261400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf691b-d5e7-430d-9c99-1a4ce85b3bca admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:24.266515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e6ca4-9190-4c22-b180-a24c92adae11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:24.267638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6ca4-9190-4c22-b180-a24c92adae11 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.268173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6ca4-9190-4c22-b180-a24c92adae11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.268619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e6ca4-9190-4c22-b180-a24c92adae11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.285426 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ab497-8a19-416c-af2b-522a407ef410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:24.287029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ab497-8a19-416c-af2b-522a407ef410 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.287169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ab497-8a19-416c-af2b-522a407ef410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.287385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ab497-8a19-416c-af2b-522a407ef410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.288475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ab497-8a19-416c-af2b-522a407ef410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:24.291633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ab497-8a19-416c-af2b-522a407ef410 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:24.305349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 805/1606] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:24 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:24.306361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ab497-8a19-416c-af2b-522a407ef410 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:24.357156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e6ca4-9190-4c22-b180-a24c92adae11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:24.359033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e6ca4-9190-4c22-b180-a24c92adae11 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:24.378719 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 802/1607] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:24.381887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7255b1e-bb51-4d8d-a6e5-b3af67124527 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.383471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7255b1e-bb51-4d8d-a6e5-b3af67124527 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.383868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7255b1e-bb51-4d8d-a6e5-b3af67124527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.402092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ab497-8a19-416c-af2b-522a407ef410 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:24.407279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58077fe3-ce05-4463-bdbe-51795fe30fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:24.408216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58077fe3-ce05-4463-bdbe-51795fe30fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.408216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58077fe3-ce05-4463-bdbe-51795fe30fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.408493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58077fe3-ce05-4463-bdbe-51795fe30fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.416772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c7255b1e-bb51-4d8d-a6e5-b3af67124527 None None] MFA Rules not processed for user `107013797d654997a149d96e76dd3dea`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:24.418086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c7255b1e-bb51-4d8d-a6e5-b3af67124527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:24.482809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58077fe3-ce05-4463-bdbe-51795fe30fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:24.485519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58077fe3-ce05-4463-bdbe-51795fe30fc7 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:24.497811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 806/1608] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:24.499461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cc41e-597b-407f-9bba-062823bbf094 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.499816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cc41e-597b-407f-9bba-062823bbf094 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.500195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cc41e-597b-407f-9bba-062823bbf094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.522258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 803/1609] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:24.525294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ec885-c218-4ed1-8b6a-d96864bcebb2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.525737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ec885-c218-4ed1-8b6a-d96864bcebb2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.526111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ec885-c218-4ed1-8b6a-d96864bcebb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.532643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-593cc41e-597b-407f-9bba-062823bbf094 None None] MFA Rules not processed for user `dc08647c12494105a06061aee97e7e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:24.533926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-593cc41e-597b-407f-9bba-062823bbf094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:24.568757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fb0ec885-c218-4ed1-8b6a-d96864bcebb2 None None] MFA Rules not processed for user `4bf99018f4784273b748be6e68e1a807`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:24.570307 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fb0ec885-c218-4ed1-8b6a-d96864bcebb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:24.584308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:24.627948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 807/1610] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:24.634582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763f67-7b29-4502-9cae-244874c07d51 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.634872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763f67-7b29-4502-9cae-244874c07d51 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.635152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92763f67-7b29-4502-9cae-244874c07d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.672062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-92763f67-7b29-4502-9cae-244874c07d51 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:24.676634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-92763f67-7b29-4502-9cae-244874c07d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:24.695927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 808/1611] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:24.698554 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92763f67-7b29-4502-9cae-244874c07d51 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:24.699333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 804/1612] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:24.700739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af14ff5-2a08-4ff8-88a0-fc3b44b07487 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.701058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af14ff5-2a08-4ff8-88a0-fc3b44b07487 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.701345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af14ff5-2a08-4ff8-88a0-fc3b44b07487 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.709442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 805/1613] 10.222.0.59 () {54 vars in 961 bytes} [Fri Jul 1 16:30:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:30:24.710322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af14ff5-2a08-4ff8-88a0-fc3b44b07487 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:24.723698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92763f67-7b29-4502-9cae-244874c07d51 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:24.734205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d79f59-d52c-4eb5-9179-62767fd873f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:24.737124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d79f59-d52c-4eb5-9179-62767fd873f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.737501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d79f59-d52c-4eb5-9179-62767fd873f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.737684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d79f59-d52c-4eb5-9179-62767fd873f7 admin admin] PATH_INFO: `/v3/projects/de72003d2e0e4a4395293a8281c3d2da/users/94e69d561087490eb018178c3af5bc3e/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.743791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af14ff5-2a08-4ff8-88a0-fc3b44b07487 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:24.759143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4676075-6be7-41db-a3fe-81cff09f4907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:24.760218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4676075-6be7-41db-a3fe-81cff09f4907 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.760522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4676075-6be7-41db-a3fe-81cff09f4907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.760797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4676075-6be7-41db-a3fe-81cff09f4907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.761534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4676075-6be7-41db-a3fe-81cff09f4907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:24.763504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4676075-6be7-41db-a3fe-81cff09f4907 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:24.782520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d79f59-d52c-4eb5-9179-62767fd873f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de72003d2e0e4a4395293a8281c3d2da, user_id=94e69d561087490eb018178c3af5bc3e, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:24.787617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d79f59-d52c-4eb5-9179-62767fd873f7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:24.791529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:24.821454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 809/1614] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:24 2022] PUT /identity/v3/projects/de72003d2e0e4a4395293a8281c3d2da/users/94e69d561087490eb018178c3af5bc3e/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:24.822790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a837f-baa3-4b45-8d60-11c6a616566b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.823079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a837f-baa3-4b45-8d60-11c6a616566b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.823358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a837f-baa3-4b45-8d60-11c6a616566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.839698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 806/1615] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:24 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:24.841208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6b0b-477a-4f9d-8f67-4fb8566c6728 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.841505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6b0b-477a-4f9d-8f67-4fb8566c6728 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.841786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc6b0b-477a-4f9d-8f67-4fb8566c6728 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.843122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 807/1616] 10.222.0.59 () {54 vars in 961 bytes} [Fri Jul 1 16:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:30:24.844605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc6b0b-477a-4f9d-8f67-4fb8566c6728 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:24.847163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7b0a837f-baa3-4b45-8d60-11c6a616566b None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:24.853794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7b0a837f-baa3-4b45-8d60-11c6a616566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:24.966120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc6b0b-477a-4f9d-8f67-4fb8566c6728 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:24.970074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3e6ca-b161-45ab-bdc9-1b0985f1819b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:24.971569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3e6ca-b161-45ab-bdc9-1b0985f1819b service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.971569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3e6ca-b161-45ab-bdc9-1b0985f1819b service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.971569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3e6ca-b161-45ab-bdc9-1b0985f1819b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:24.980087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 810/1617] 10.222.0.59 () {58 vars in 1058 bytes} [Fri Jul 1 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:24.993058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f59a5-bd34-4925-95b5-3e8bf666e922 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:24.993472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f59a5-bd34-4925-95b5-3e8bf666e922 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:24.993850 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f59a5-bd34-4925-95b5-3e8bf666e922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.020493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-4a7f59a5-bd34-4925-95b5-3e8bf666e922 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:25.022411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4a7f59a5-bd34-4925-95b5-3e8bf666e922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:25.114436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3e6ca-b161-45ab-bdc9-1b0985f1819b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:25.117557 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3e6ca-b161-45ab-bdc9-1b0985f1819b service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:25.141780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 808/1618] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:25.149320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3e6ca-b161-45ab-bdc9-1b0985f1819b service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:25.166742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3e6ca-b161-45ab-bdc9-1b0985f1819b service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:25.191120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dea3f-a0f2-4b14-9263-aa395950fe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:25.193261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dea3f-a0f2-4b14-9263-aa395950fe94 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.193677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dea3f-a0f2-4b14-9263-aa395950fe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.193905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 811/1619] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:25.194157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dea3f-a0f2-4b14-9263-aa395950fe94 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.194974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dea3f-a0f2-4b14-9263-aa395950fe94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:25.195178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc38d9-2af7-461d-9c97-55d75b2b7249 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.195457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc38d9-2af7-461d-9c97-55d75b2b7249 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.195736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc38d9-2af7-461d-9c97-55d75b2b7249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.198492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dea3f-a0f2-4b14-9263-aa395950fe94 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:25.257389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 809/1620] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:25 2022] POST /identity/v3/users => generated 309 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:25.258306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dea3f-a0f2-4b14-9263-aa395950fe94 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:25.285301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dea3f-a0f2-4b14-9263-aa395950fe94 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:25.288727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-63fc38d9-2af7-461d-9c97-55d75b2b7249 None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:25.290204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-63fc38d9-2af7-461d-9c97-55d75b2b7249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:25.302906 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbe182-2512-45e0-8363-8bd40f41e16b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:25.303753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbe182-2512-45e0-8363-8bd40f41e16b service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.304051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbe182-2512-45e0-8363-8bd40f41e16b service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.304299 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbe182-2512-45e0-8363-8bd40f41e16b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.310724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 812/1621] 10.222.0.59 () {58 vars in 1058 bytes} [Fri Jul 1 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:25.312699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc38d9-2af7-461d-9c97-55d75b2b7249 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:25.328186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc38d9-2af7-461d-9c97-55d75b2b7249 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:25.341408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7dcb7-05ed-49a8-aafd-c6765db3ae7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:25.342194 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7dcb7-05ed-49a8-aafd-c6765db3ae7d service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.342543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7dcb7-05ed-49a8-aafd-c6765db3ae7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.343566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7dcb7-05ed-49a8-aafd-c6765db3ae7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.364313 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7dcb7-05ed-49a8-aafd-c6765db3ae7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:25.366159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7dcb7-05ed-49a8-aafd-c6765db3ae7d service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:25.389974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 813/1622] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:25.390982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7dcb7-05ed-49a8-aafd-c6765db3ae7d service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:25.409255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7dcb7-05ed-49a8-aafd-c6765db3ae7d service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:25.427916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1384c-7dc8-4695-953b-6a8ff74d4d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:25.428714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1384c-7dc8-4695-953b-6a8ff74d4d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.429098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1384c-7dc8-4695-953b-6a8ff74d4d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.429609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1384c-7dc8-4695-953b-6a8ff74d4d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.430492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1384c-7dc8-4695-953b-6a8ff74d4d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:25.432229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1384c-7dc8-4695-953b-6a8ff74d4d9c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:25.433044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbe182-2512-45e0-8363-8bd40f41e16b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:25.443090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbe182-2512-45e0-8363-8bd40f41e16b service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:25.455761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 814/1623] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:25.455761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1384c-7dc8-4695-953b-6a8ff74d4d9c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:25.469340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 810/1624] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:25.471150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbe182-2512-45e0-8363-8bd40f41e16b service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:25.483628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbe182-2512-45e0-8363-8bd40f41e16b service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:25.492618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a459551-b23c-4611-9162-08708f1c0483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:25.493786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a459551-b23c-4611-9162-08708f1c0483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.494130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a459551-b23c-4611-9162-08708f1c0483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.494420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a459551-b23c-4611-9162-08708f1c0483 admin admin] PATH_INFO: `/v3/projects/ca73769f5c204713951e0b68090cd5f5/users/75eb539facfe4a73919e7b75818e596c/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.497375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1384c-7dc8-4695-953b-6a8ff74d4d9c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:25.523827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fafebe-e58d-45bf-8a71-067bf0c64854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:25.524402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fafebe-e58d-45bf-8a71-067bf0c64854 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.524682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fafebe-e58d-45bf-8a71-067bf0c64854 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.527496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fafebe-e58d-45bf-8a71-067bf0c64854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.527652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a459551-b23c-4611-9162-08708f1c0483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca73769f5c204713951e0b68090cd5f5, user_id=75eb539facfe4a73919e7b75818e596c, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:25.532581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a459551-b23c-4611-9162-08708f1c0483 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:25.536276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:25.560294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:25.562516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 811/1625] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:25 2022] PUT /identity/v3/projects/ca73769f5c204713951e0b68090cd5f5/users/75eb539facfe4a73919e7b75818e596c/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:25.567693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a459551-b23c-4611-9162-08708f1c0483 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:25.677660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fafebe-e58d-45bf-8a71-067bf0c64854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:25.679316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fafebe-e58d-45bf-8a71-067bf0c64854 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:25.723005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a459551-b23c-4611-9162-08708f1c0483 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:25.724047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 815/1626] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:25.742226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0236ad-a1b5-463e-bcd5-2f9dd528d689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:25.744392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0236ad-a1b5-463e-bcd5-2f9dd528d689 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.746801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0236ad-a1b5-463e-bcd5-2f9dd528d689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.747214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0236ad-a1b5-463e-bcd5-2f9dd528d689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.748254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0236ad-a1b5-463e-bcd5-2f9dd528d689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:25.756274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0236ad-a1b5-463e-bcd5-2f9dd528d689 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:25.788509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 812/1627] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:25.793453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fafebe-e58d-45bf-8a71-067bf0c64854 service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:25.813428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fafebe-e58d-45bf-8a71-067bf0c64854 service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:25.825612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de185a-a6eb-4a9f-ac59-cc431262e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:25.836930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de185a-a6eb-4a9f-ac59-cc431262e6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.837235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de185a-a6eb-4a9f-ac59-cc431262e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.841410 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de185a-a6eb-4a9f-ac59-cc431262e6c6 admin admin] PATH_INFO: `/v3/projects/ca73769f5c204713951e0b68090cd5f5/users/75eb539facfe4a73919e7b75818e596c/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.858798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de185a-a6eb-4a9f-ac59-cc431262e6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca73769f5c204713951e0b68090cd5f5, user_id=75eb539facfe4a73919e7b75818e596c, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:25.877811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de185a-a6eb-4a9f-ac59-cc431262e6c6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:25.932580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 816/1628] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:25 2022] PUT /identity/v3/projects/ca73769f5c204713951e0b68090cd5f5/users/75eb539facfe4a73919e7b75818e596c/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:25.938812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d409d42-6633-4255-b940-513e46c1d237 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:25.939583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d409d42-6633-4255-b940-513e46c1d237 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:25.939959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d409d42-6633-4255-b940-513e46c1d237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:25.992411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1d409d42-6633-4255-b940-513e46c1d237 None None] MFA Rules not processed for user `75eb539facfe4a73919e7b75818e596c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:25.995979 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1d409d42-6633-4255-b940-513e46c1d237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:26.218856 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 813/1629] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:25 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:26.229788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de185a-a6eb-4a9f-ac59-cc431262e6c6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:26.362401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3b5c0-67ef-43f9-85c2-af3bf963864a None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:26.362802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3b5c0-67ef-43f9-85c2-af3bf963864a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:26.363197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3b5c0-67ef-43f9-85c2-af3bf963864a None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:26.364947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 814/1630] 10.222.0.59 () {54 vars in 912 bytes} [Fri Jul 1 16:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:30:26.376573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c376c2-3f08-4d7f-8c83-8a3791722d1a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:26.377003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c376c2-3f08-4d7f-8c83-8a3791722d1a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:26.377381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c376c2-3f08-4d7f-8c83-8a3791722d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:26.410506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-79c376c2-3f08-4d7f-8c83-8a3791722d1a None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:26.411853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-79c376c2-3f08-4d7f-8c83-8a3791722d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:26.563385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de185a-a6eb-4a9f-ac59-cc431262e6c6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:26.598618 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4058ab5-cdb6-4efc-ac2b-3a1a1cf90105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:26.600749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4058ab5-cdb6-4efc-ac2b-3a1a1cf90105 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:26.602118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4058ab5-cdb6-4efc-ac2b-3a1a1cf90105 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:26.602786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4058ab5-cdb6-4efc-ac2b-3a1a1cf90105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:26.633013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4058ab5-cdb6-4efc-ac2b-3a1a1cf90105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:26.634856 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4058ab5-cdb6-4efc-ac2b-3a1a1cf90105 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:26.666007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 817/1631] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:26 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:26.667836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f36c-c229-4eb4-a510-fb9843de8423 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:26.668267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f36c-c229-4eb4-a510-fb9843de8423 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:26.668709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0f36c-c229-4eb4-a510-fb9843de8423 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:26.670353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 818/1632] 10.222.0.59 () {54 vars in 912 bytes} [Fri Jul 1 16:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:30:26.684418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b0642-0611-4618-96a8-b815b8ff15dd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:26.685553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b0642-0611-4618-96a8-b815b8ff15dd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:26.686504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b0642-0611-4618-96a8-b815b8ff15dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:26.789720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b81b0642-0611-4618-96a8-b815b8ff15dd None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:26.825806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b81b0642-0611-4618-96a8-b815b8ff15dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:27.006457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 815/1633] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 632 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:30:27.042176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c376c2-3f08-4d7f-8c83-8a3791722d1a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:27.044795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 819/1634] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:30:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:27.048813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b0642-0611-4618-96a8-b815b8ff15dd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:27.057931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:27.063030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b0642-0611-4618-96a8-b815b8ff15dd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:27.067743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2e195-ecb8-4eec-ba8b-e3f060d45299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:27.068472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2e195-ecb8-4eec-ba8b-e3f060d45299 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:27.068755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2e195-ecb8-4eec-ba8b-e3f060d45299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:27.069064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2e195-ecb8-4eec-ba8b-e3f060d45299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:27.091858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2e195-ecb8-4eec-ba8b-e3f060d45299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:27.093564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2e195-ecb8-4eec-ba8b-e3f060d45299 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:27.143112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 820/1635] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:30:27.144260 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2e195-ecb8-4eec-ba8b-e3f060d45299 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:27.178215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2e195-ecb8-4eec-ba8b-e3f060d45299 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:27.192105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc4516-445a-4810-8d66-96accc7bdd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:27.196153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4516-445a-4810-8d66-96accc7bdd6f service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:27.197357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4516-445a-4810-8d66-96accc7bdd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:27.197792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc4516-445a-4810-8d66-96accc7bdd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:27.226650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c376c2-3f08-4d7f-8c83-8a3791722d1a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:27.231273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4516-445a-4810-8d66-96accc7bdd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:27.233199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc4516-445a-4810-8d66-96accc7bdd6f service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:27.243688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:27.245133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:27.245595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:27.246042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] PATH_INFO: `/v3/users/dc08647c12494105a06061aee97e7e47` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:27.248002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc08647c12494105a06061aee97e7e47)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:27.251575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:27.263245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 821/1636] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:27.345287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc08647c12494105a06061aee97e7e47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:27.346887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc08647c12494105a06061aee97e7e47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:27.347556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc08647c12494105a06061aee97e7e47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:27.363998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc08647c12494105a06061aee97e7e47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:27.374080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc08647c12494105a06061aee97e7e47'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:27.404089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 816/1637] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:27 2022] DELETE /identity/v3/users/dc08647c12494105a06061aee97e7e47 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:27.409528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21596a1-a199-4186-88e3-220d5e8471d1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:27.409933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21596a1-a199-4186-88e3-220d5e8471d1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:27.410205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21596a1-a199-4186-88e3-220d5e8471d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:27.430678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:27.445164 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b21596a1-a199-4186-88e3-220d5e8471d1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:27.449670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b21596a1-a199-4186-88e3-220d5e8471d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:27.599193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 822/1638] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:27.630730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:27.632383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:27.821651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17bbc6-6cfb-43bd-9c21-a0edb3db861c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:27.835074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a33d74-2072-4894-bd57-8c794bee7082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:27.836426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a33d74-2072-4894-bd57-8c794bee7082 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:27.836744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a33d74-2072-4894-bd57-8c794bee7082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:27.837093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a33d74-2072-4894-bd57-8c794bee7082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:27.872233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a33d74-2072-4894-bd57-8c794bee7082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:27.885276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a33d74-2072-4894-bd57-8c794bee7082 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:27.929166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 817/1639] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:29.443018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21596a1-a199-4186-88e3-220d5e8471d1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:29.447301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b21596a1-a199-4186-88e3-220d5e8471d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:29.467618 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21596a1-a199-4186-88e3-220d5e8471d1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:29.482656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:29.484603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:29.484603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:29.484821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] PATH_INFO: `/v3/projects/99dbcdefb4404fcfbe7b822e9958357d` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:29.493066 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99dbcdefb4404fcfbe7b822e9958357d)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:29.495307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:29.603982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99dbcdefb4404fcfbe7b822e9958357d', 'request_id': 'req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:29.622318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99dbcdefb4404fcfbe7b822e9958357d', 'request_id': 'req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:29.643968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99dbcdefb4404fcfbe7b822e9958357d', 'request_id': 'req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:29.661526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] The token cache is being invalidate because project 99dbcdefb4404fcfbe7b822e9958357d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:29.661526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:29.665313 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:29.667335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 823/1640] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:29 2022] DELETE /identity/v3/projects/99dbcdefb4404fcfbe7b822e9958357d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:29.671264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a33d74-2072-4894-bd57-8c794bee7082 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:29.684186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a33d74-2072-4894-bd57-8c794bee7082 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:29.755118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:29.852222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:29.853363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:29.853759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:29.854072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] PATH_INFO: `/v3/users/75eb539facfe4a73919e7b75818e596c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:29.857776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] RBAC: Authorizing `identity:delete_user(user_id=75eb539facfe4a73919e7b75818e596c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:29.861499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:29.983777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75eb539facfe4a73919e7b75818e596c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:29.987367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75eb539facfe4a73919e7b75818e596c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:29.991306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75eb539facfe4a73919e7b75818e596c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:30.052070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75eb539facfe4a73919e7b75818e596c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:30.075761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c167024e-a283-42dc-8eea-080ff71fe33c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75eb539facfe4a73919e7b75818e596c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:30.113018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 818/1641] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:29 2022] DELETE /identity/v3/users/75eb539facfe4a73919e7b75818e596c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:30.284230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:30.284230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:30.306324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e26d58e-3f30-403a-9a49-5b6e6ecdebe0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:30.482699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:30.483614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:30.483922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:30.486647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] PATH_INFO: `/v3/users/4bf99018f4784273b748be6e68e1a807` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:30.489358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf99018f4784273b748be6e68e1a807)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:30.493311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: WARNING py.warnings [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:30:30.493311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: warnings.warn(msg) Jul 01 16:30:30.493311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: Jul 01 16:30:30.496142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:30.620787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:30.650252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf99018f4784273b748be6e68e1a807'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:30.651747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf99018f4784273b748be6e68e1a807'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:30.666897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf99018f4784273b748be6e68e1a807'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:30.683679 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf99018f4784273b748be6e68e1a807'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:30.685464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf99018f4784273b748be6e68e1a807'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:30.732740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 824/1642] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:30 2022] DELETE /identity/v3/users/4bf99018f4784273b748be6e68e1a807 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:30.733175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfe6fd-fd89-4812-8172-6bcd874640d5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:30.733709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfe6fd-fd89-4812-8172-6bcd874640d5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:30.733803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfe6fd-fd89-4812-8172-6bcd874640d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:30.770884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-abcfe6fd-fd89-4812-8172-6bcd874640d5 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:30.773457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-abcfe6fd-fd89-4812-8172-6bcd874640d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:30.897847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 819/1643] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:30.912136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:30.922856 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:31.055770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ea8db-451e-4578-9ce4-f2335c43b4ea admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:31.059748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67506044-8180-4c29-9a77-0297843182c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:31.060743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67506044-8180-4c29-9a77-0297843182c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:31.061236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67506044-8180-4c29-9a77-0297843182c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:31.061517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67506044-8180-4c29-9a77-0297843182c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:31.085521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67506044-8180-4c29-9a77-0297843182c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:31.087015 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67506044-8180-4c29-9a77-0297843182c4 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:31.109326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 825/1644] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:32.980817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfe6fd-fd89-4812-8172-6bcd874640d5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:32.982319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-abcfe6fd-fd89-4812-8172-6bcd874640d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:33.006287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfe6fd-fd89-4812-8172-6bcd874640d5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:33.027193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:33.028058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:33.028345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:33.028629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] PATH_INFO: `/v3/projects/ca73769f5c204713951e0b68090cd5f5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:33.030375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca73769f5c204713951e0b68090cd5f5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:33.031491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: WARNING py.warnings [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 01 16:30:33.031491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: warnings.warn(msg) Jul 01 16:30:33.031491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: Jul 01 16:30:33.037538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:33.164400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:33.177257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca73769f5c204713951e0b68090cd5f5', 'request_id': 'req-cc792251-36f6-4a5d-830e-a36e60a67c91'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.225154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca73769f5c204713951e0b68090cd5f5', 'request_id': 'req-cc792251-36f6-4a5d-830e-a36e60a67c91'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.252136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca73769f5c204713951e0b68090cd5f5', 'request_id': 'req-cc792251-36f6-4a5d-830e-a36e60a67c91'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.294018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] The token cache is being invalidate because project ca73769f5c204713951e0b68090cd5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:33.294314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.296093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc792251-36f6-4a5d-830e-a36e60a67c91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.298367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 820/1645] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:32 2022] DELETE /identity/v3/projects/ca73769f5c204713951e0b68090cd5f5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:30:33.304099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa20fd-b048-42d5-b1f5-9d9400673a8b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:33.304964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa20fd-b048-42d5-b1f5-9d9400673a8b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:33.305736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa20fd-b048-42d5-b1f5-9d9400673a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:33.353151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d1aa20fd-b048-42d5-b1f5-9d9400673a8b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:33.354423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d1aa20fd-b048-42d5-b1f5-9d9400673a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:33.556655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 826/1646] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:33.564380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3540dd-d076-41c3-a29c-178164e08abd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:33.564974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3540dd-d076-41c3-a29c-178164e08abd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:33.565544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3540dd-d076-41c3-a29c-178164e08abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:33.606188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa20fd-b048-42d5-b1f5-9d9400673a8b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:33.608187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d1aa20fd-b048-42d5-b1f5-9d9400673a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:33.631470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa20fd-b048-42d5-b1f5-9d9400673a8b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:33.640184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8e3540dd-d076-41c3-a29c-178164e08abd None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:33.642563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8e3540dd-d076-41c3-a29c-178164e08abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:33.650498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:33.653697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:33.653993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:33.654276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] PATH_INFO: `/v3/projects/1fe7d9d8a18a4460b6192e49f28ca4db` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:33.657642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe7d9d8a18a4460b6192e49f28ca4db)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:33.659651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:33.661606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 821/1647] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:33.666079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3540dd-d076-41c3-a29c-178164e08abd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:33.694819 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3540dd-d076-41c3-a29c-178164e08abd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:33.708652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b2fd8-12ee-4ec3-b6a6-31277e6819d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:33.709622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b2fd8-12ee-4ec3-b6a6-31277e6819d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:33.710207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b2fd8-12ee-4ec3-b6a6-31277e6819d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:33.710630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b2fd8-12ee-4ec3-b6a6-31277e6819d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:33.711522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b2fd8-12ee-4ec3-b6a6-31277e6819d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:33.713251 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b2fd8-12ee-4ec3-b6a6-31277e6819d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:33.716787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b2fd8-12ee-4ec3-b6a6-31277e6819d1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:33.762485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 822/1648] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:33.763577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b2fd8-12ee-4ec3-b6a6-31277e6819d1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:33.787201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b2fd8-12ee-4ec3-b6a6-31277e6819d1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:33.811071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:33.816948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe7d9d8a18a4460b6192e49f28ca4db', 'request_id': 'req-2c43d983-c842-4732-a640-41fd90e35d31'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.833574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe7d9d8a18a4460b6192e49f28ca4db', 'request_id': 'req-2c43d983-c842-4732-a640-41fd90e35d31'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.857774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe7d9d8a18a4460b6192e49f28ca4db', 'request_id': 'req-2c43d983-c842-4732-a640-41fd90e35d31'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.903551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] The token cache is being invalidate because project 1fe7d9d8a18a4460b6192e49f28ca4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:33.905277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.908118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-2c43d983-c842-4732-a640-41fd90e35d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:33.913152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 827/1649] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:33 2022] DELETE /identity/v3/projects/1fe7d9d8a18a4460b6192e49f28ca4db => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:33.918037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f0eee-4091-4cda-9461-9f4c9f662bcc None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:33.918586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f0eee-4091-4cda-9461-9f4c9f662bcc None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:33.943679 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f0eee-4091-4cda-9461-9f4c9f662bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:33.970355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e9692-51e5-43d9-b6df-3bc3df62c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:33.971398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9692-51e5-43d9-b6df-3bc3df62c5fe admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:33.971683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9692-51e5-43d9-b6df-3bc3df62c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:33.971960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e9692-51e5-43d9-b6df-3bc3df62c5fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:33.972674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e9692-51e5-43d9-b6df-3bc3df62c5fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:33.973058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-359f0eee-4091-4cda-9461-9f4c9f662bcc None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:33.974584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-359f0eee-4091-4cda-9461-9f4c9f662bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:33.984349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e9692-51e5-43d9-b6df-3bc3df62c5fe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:34.063740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 823/1650] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:33 2022] POST /identity/v3/projects => generated 379 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:34.063915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 828/1651] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:34.065451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f0eee-4091-4cda-9461-9f4c9f662bcc None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:34.068545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f9369-5098-496e-b915-313c4a785634 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.069101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f9369-5098-496e-b915-313c4a785634 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.076423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f9369-5098-496e-b915-313c4a785634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.078277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-359f0eee-4091-4cda-9461-9f4c9f662bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:34.102240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f0eee-4091-4cda-9461-9f4c9f662bcc None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:34.127972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-3e7f9369-5098-496e-b915-313c4a785634 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:34.129276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3e7f9369-5098-496e-b915-313c4a785634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:34.235587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc486a6-dadf-4760-a29f-b3d785d4f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:34.236310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc486a6-dadf-4760-a29f-b3d785d4f2ab admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.236598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc486a6-dadf-4760-a29f-b3d785d4f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.236876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc486a6-dadf-4760-a29f-b3d785d4f2ab admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.239172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc486a6-dadf-4760-a29f-b3d785d4f2ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:34.241411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc486a6-dadf-4760-a29f-b3d785d4f2ab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:34.273933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 824/1652] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:34.284927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f9369-5098-496e-b915-313c4a785634 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:34.307375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 829/1653] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:34 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:34.311684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc486a6-dadf-4760-a29f-b3d785d4f2ab admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:34.320822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f9369-5098-496e-b915-313c4a785634 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:34.334561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fae492-f784-4ba7-b517-c5060d2df5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:34.335267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fae492-f784-4ba7-b517-c5060d2df5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.335977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fae492-f784-4ba7-b517-c5060d2df5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.336256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fae492-f784-4ba7-b517-c5060d2df5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.337031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fae492-f784-4ba7-b517-c5060d2df5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:34.340102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc486a6-dadf-4760-a29f-b3d785d4f2ab admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:34.344658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fae492-f784-4ba7-b517-c5060d2df5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:34.347084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fae492-f784-4ba7-b517-c5060d2df5e4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:34.365353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5f41-199d-42dd-a454-1e7947ea8532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:34.366275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5f41-199d-42dd-a454-1e7947ea8532 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.366822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5f41-199d-42dd-a454-1e7947ea8532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.367229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a5f41-199d-42dd-a454-1e7947ea8532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.369731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a5f41-199d-42dd-a454-1e7947ea8532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:34.378830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a5f41-199d-42dd-a454-1e7947ea8532 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:34.388859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 825/1654] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:34.397834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fae492-f784-4ba7-b517-c5060d2df5e4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:34.409902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 830/1655] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:34.419477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5f41-199d-42dd-a454-1e7947ea8532 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:34.431805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fae492-f784-4ba7-b517-c5060d2df5e4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:34.434841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a5f41-199d-42dd-a454-1e7947ea8532 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:34.448611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f549fe5-9de2-48f4-89be-934fd68ae765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:34.450063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f549fe5-9de2-48f4-89be-934fd68ae765 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.450361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f549fe5-9de2-48f4-89be-934fd68ae765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.450698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f549fe5-9de2-48f4-89be-934fd68ae765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.451263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d9d4-0768-4c2a-9c14-3f20e3ed054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:34.451432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f549fe5-9de2-48f4-89be-934fd68ae765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:34.452277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d9d4-0768-4c2a-9c14-3f20e3ed054b admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.452786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d9d4-0768-4c2a-9c14-3f20e3ed054b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.453270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d9d4-0768-4c2a-9c14-3f20e3ed054b admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.457189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98d9d4-0768-4c2a-9c14-3f20e3ed054b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:34.459352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98d9d4-0768-4c2a-9c14-3f20e3ed054b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:34.464692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f549fe5-9de2-48f4-89be-934fd68ae765 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:34.496536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 831/1656] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:34.497700 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d9d4-0768-4c2a-9c14-3f20e3ed054b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:34.515207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d9d4-0768-4c2a-9c14-3f20e3ed054b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:34.528978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a41a8-02af-4d98-8cd5-1092f7a67480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:34.530308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a41a8-02af-4d98-8cd5-1092f7a67480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.530660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a41a8-02af-4d98-8cd5-1092f7a67480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.530979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a41a8-02af-4d98-8cd5-1092f7a67480 admin admin] PATH_INFO: `/v3/projects/1f9b91267bd74b8d9a8a272cf246ef75/users/abb98110d5464ef9bd8997b7b8a9e814/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.533998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 826/1657] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:34 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:34.538513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f549fe5-9de2-48f4-89be-934fd68ae765 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:34.552354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:34.591609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a41a8-02af-4d98-8cd5-1092f7a67480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9b91267bd74b8d9a8a272cf246ef75, user_id=abb98110d5464ef9bd8997b7b8a9e814, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:34.599794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a41a8-02af-4d98-8cd5-1092f7a67480 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:34.666184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 832/1658] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:34 2022] PUT /identity/v3/projects/1f9b91267bd74b8d9a8a272cf246ef75/users/abb98110d5464ef9bd8997b7b8a9e814/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:34.670542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ba08-411d-4db4-a688-134e30b851db None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.670542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ba08-411d-4db4-a688-134e30b851db None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.671737 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ba08-411d-4db4-a688-134e30b851db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.702856 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f549fe5-9de2-48f4-89be-934fd68ae765 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:34.770851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2505ba08-411d-4db4-a688-134e30b851db None None] MFA Rules not processed for user `abb98110d5464ef9bd8997b7b8a9e814`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:34.772147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2505ba08-411d-4db4-a688-134e30b851db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:34.843095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bbed4-6a9a-49c1-932f-fdcd07eb43c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:34.844018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbed4-6a9a-49c1-932f-fdcd07eb43c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.844305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbed4-6a9a-49c1-932f-fdcd07eb43c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.844581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbed4-6a9a-49c1-932f-fdcd07eb43c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.845343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bbed4-6a9a-49c1-932f-fdcd07eb43c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:34.849829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bbed4-6a9a-49c1-932f-fdcd07eb43c3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:34.903097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 827/1659] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:34 2022] POST /identity/v3/users => generated 287 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:34.903097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bbed4-6a9a-49c1-932f-fdcd07eb43c3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:34.912759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bf5bbed4-6a9a-49c1-932f-fdcd07eb43c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:34.918638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 833/1660] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:34.920445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505ba08-411d-4db4-a688-134e30b851db None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:34.936375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:34.939383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bbed4-6a9a-49c1-932f-fdcd07eb43c3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:34.949513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505ba08-411d-4db4-a688-134e30b851db None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:34.956701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:34.959502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.959795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.960103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] PATH_INFO: `/v3/users/107013797d654997a149d96e76dd3dea` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.962716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=107013797d654997a149d96e76dd3dea)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:34.967890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:34.968219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa326-6ad3-4ba2-a75f-57eaa8fbded4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:34.973111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa326-6ad3-4ba2-a75f-57eaa8fbded4 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:34.975038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa326-6ad3-4ba2-a75f-57eaa8fbded4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:34.975322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafa326-6ad3-4ba2-a75f-57eaa8fbded4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:34.976397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafa326-6ad3-4ba2-a75f-57eaa8fbded4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:34.978220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafa326-6ad3-4ba2-a75f-57eaa8fbded4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:35.083532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 834/1661] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:35.090675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107013797d654997a149d96e76dd3dea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:35.091522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa326-6ad3-4ba2-a75f-57eaa8fbded4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:35.091627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107013797d654997a149d96e76dd3dea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:35.092348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107013797d654997a149d96e76dd3dea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:35.096049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5aafa326-6ad3-4ba2-a75f-57eaa8fbded4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:35.126436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107013797d654997a149d96e76dd3dea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:35.128351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafa326-6ad3-4ba2-a75f-57eaa8fbded4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:35.143638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6eaf4-0264-479c-a241-e8d37c7a1b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:35.144440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6eaf4-0264-479c-a241-e8d37c7a1b74 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.144949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6eaf4-0264-479c-a241-e8d37c7a1b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.145302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6eaf4-0264-479c-a241-e8d37c7a1b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:35.146682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6eaf4-0264-479c-a241-e8d37c7a1b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:35.148687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107013797d654997a149d96e76dd3dea'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:35.153748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6eaf4-0264-479c-a241-e8d37c7a1b74 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:35.179980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 828/1662] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:34 2022] DELETE /identity/v3/users/107013797d654997a149d96e76dd3dea => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:35.180957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:35.185457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:35.225823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:35.230599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 835/1663] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:35 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:35.232014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e7e19-ef40-403a-9510-ead438fe046e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.238431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e7e19-ef40-403a-9510-ead438fe046e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.239448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e7e19-ef40-403a-9510-ead438fe046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:35.288152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-303e7e19-ef40-403a-9510-ead438fe046e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:35.289507 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-303e7e19-ef40-403a-9510-ead438fe046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:35.371786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92273df3-855d-486e-abf8-943b5f7077e7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:35.486827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 836/1664] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:35.488350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e7e19-ef40-403a-9510-ead438fe046e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:35.517886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e7e19-ef40-403a-9510-ead438fe046e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:35.529258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c544b8-e22d-4508-8551-5d2ccc7a4ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:35.529945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c544b8-e22d-4508-8551-5d2ccc7a4ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.530229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c544b8-e22d-4508-8551-5d2ccc7a4ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.530506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c544b8-e22d-4508-8551-5d2ccc7a4ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:35.532464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c544b8-e22d-4508-8551-5d2ccc7a4ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:35.534829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c544b8-e22d-4508-8551-5d2ccc7a4ba3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:35.558195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3a358-dc02-4dcf-9d09-8d09310a02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:35.558899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3a358-dc02-4dcf-9d09-8d09310a02f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.559189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3a358-dc02-4dcf-9d09-8d09310a02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.559468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3a358-dc02-4dcf-9d09-8d09310a02f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:35.560218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3a358-dc02-4dcf-9d09-8d09310a02f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:35.561949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3a358-dc02-4dcf-9d09-8d09310a02f5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:35.588187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 837/1665] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:35 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:35.592832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c544b8-e22d-4508-8551-5d2ccc7a4ba3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:35.594479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 829/1666] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:35.597364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3a358-dc02-4dcf-9d09-8d09310a02f5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:35.620196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3a358-dc02-4dcf-9d09-8d09310a02f5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:35.620924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c544b8-e22d-4508-8551-5d2ccc7a4ba3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:35.630675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ddec9-9b2f-455d-a602-710d0ffcde59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:35.632608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ddec9-9b2f-455d-a602-710d0ffcde59 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.632915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ddec9-9b2f-455d-a602-710d0ffcde59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.634056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ddec9-9b2f-455d-a602-710d0ffcde59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:35.634827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ddec9-9b2f-455d-a602-710d0ffcde59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:35.637713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6453-9795-4386-b70e-d9494cfbdb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:35.637713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6453-9795-4386-b70e-d9494cfbdb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.639541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6453-9795-4386-b70e-d9494cfbdb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.639869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6453-9795-4386-b70e-d9494cfbdb30 admin admin] PATH_INFO: `/v3/projects/0d3de5f0a37244158b5c735dc2ca2dd2/users/fa353b90c16b4c55a440ea1b75235679/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:35.641988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ddec9-9b2f-455d-a602-710d0ffcde59 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:35.676824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 838/1667] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:35.677802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ddec9-9b2f-455d-a602-710d0ffcde59 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:35.682910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3f0ddec9-9b2f-455d-a602-710d0ffcde59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:35.686603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6453-9795-4386-b70e-d9494cfbdb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3de5f0a37244158b5c735dc2ca2dd2, user_id=fa353b90c16b4c55a440ea1b75235679, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:35.690482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6453-9795-4386-b70e-d9494cfbdb30 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:35.725007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 830/1668] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:35 2022] PUT /identity/v3/projects/0d3de5f0a37244158b5c735dc2ca2dd2/users/fa353b90c16b4c55a440ea1b75235679/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:35.736154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6453-9795-4386-b70e-d9494cfbdb30 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:35.845283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ddec9-9b2f-455d-a602-710d0ffcde59 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:35.903452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6453-9795-4386-b70e-d9494cfbdb30 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:35.920750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdaac96-e1b2-42d3-9458-c503cc924112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:35.922130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaac96-e1b2-42d3-9458-c503cc924112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.924539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaac96-e1b2-42d3-9458-c503cc924112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.925083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaac96-e1b2-42d3-9458-c503cc924112 admin admin] PATH_INFO: `/v3/projects/8a3ba08392bc448c9fc7d4ce08780b48/users/81b74359be274941ac8aa82a9d4b6d08/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:35.927870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa25ae7-7b19-490f-8ece-d2d65d769b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:35.928544 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25ae7-7b19-490f-8ece-d2d65d769b16 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.928822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25ae7-7b19-490f-8ece-d2d65d769b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.930761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa25ae7-7b19-490f-8ece-d2d65d769b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:35.950254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25ae7-7b19-490f-8ece-d2d65d769b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:35.952317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa25ae7-7b19-490f-8ece-d2d65d769b16 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:35.960173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdaac96-e1b2-42d3-9458-c503cc924112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3ba08392bc448c9fc7d4ce08780b48, user_id=81b74359be274941ac8aa82a9d4b6d08, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:35.961974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:35.966232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdaac96-e1b2-42d3-9458-c503cc924112 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:35.969781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 839/1669] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:35.971929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af938828-51aa-4d20-bf53-f008df15b66c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.972465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af938828-51aa-4d20-bf53-f008df15b66c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.973322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af938828-51aa-4d20-bf53-f008df15b66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:35.996496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 831/1670] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:35 2022] PUT /identity/v3/projects/8a3ba08392bc448c9fc7d4ce08780b48/users/81b74359be274941ac8aa82a9d4b6d08/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:35.998082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c03799-6bf6-467d-99c8-1a9e7b939d13 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:35.998529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c03799-6bf6-467d-99c8-1a9e7b939d13 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:35.998956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c03799-6bf6-467d-99c8-1a9e7b939d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:36.018754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-af938828-51aa-4d20-bf53-f008df15b66c None None] MFA Rules not processed for user `fa353b90c16b4c55a440ea1b75235679`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:36.020279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-af938828-51aa-4d20-bf53-f008df15b66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:36.040920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b8c03799-6bf6-467d-99c8-1a9e7b939d13 None None] MFA Rules not processed for user `23265f35b4c44341b9bca85b613f56af`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:36.042619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b8c03799-6bf6-467d-99c8-1a9e7b939d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:36.049913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:36.144385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 832/1671] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:36.156066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c03799-6bf6-467d-99c8-1a9e7b939d13 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:36.182161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 840/1672] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:36.199365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df549-7fc6-463e-bcf7-596043e74091 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:36.200168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df549-7fc6-463e-bcf7-596043e74091 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:36.200963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4df549-7fc6-463e-bcf7-596043e74091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:36.238118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bd4df549-7fc6-463e-bcf7-596043e74091 None None] MFA Rules not processed for user `23265f35b4c44341b9bca85b613f56af`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:36.242519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bd4df549-7fc6-463e-bcf7-596043e74091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:36.270301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 841/1673] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:36.271501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df549-7fc6-463e-bcf7-596043e74091 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:36.295926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bd4df549-7fc6-463e-bcf7-596043e74091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:36.347674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c03799-6bf6-467d-99c8-1a9e7b939d13 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:36.361052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c9aec-8128-4543-84cf-1583d43fc2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:36.361771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c9aec-8128-4543-84cf-1583d43fc2be admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:36.362047 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c9aec-8128-4543-84cf-1583d43fc2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:36.362332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c9aec-8128-4543-84cf-1583d43fc2be admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:36.365098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c9aec-8128-4543-84cf-1583d43fc2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:36.369892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c9aec-8128-4543-84cf-1583d43fc2be admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:36.396443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 833/1674] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:36.396443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c9aec-8128-4543-84cf-1583d43fc2be admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:36.401789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-355c9aec-8128-4543-84cf-1583d43fc2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:36.607986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4df549-7fc6-463e-bcf7-596043e74091 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:36.620373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c9aec-8128-4543-84cf-1583d43fc2be admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:36.622068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10e27e-00d2-403b-9429-72aff89725e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:36.623113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e27e-00d2-403b-9429-72aff89725e3 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:36.623538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e27e-00d2-403b-9429-72aff89725e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:36.623953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10e27e-00d2-403b-9429-72aff89725e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:36.635750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff69354-b106-474e-b244-e0b4cc424e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:36.638079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff69354-b106-474e-b244-e0b4cc424e16 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:36.638442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff69354-b106-474e-b244-e0b4cc424e16 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:36.638781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff69354-b106-474e-b244-e0b4cc424e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:36.644097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10e27e-00d2-403b-9429-72aff89725e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:36.653595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10e27e-00d2-403b-9429-72aff89725e3 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:36.666022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff69354-b106-474e-b244-e0b4cc424e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:36.667681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff69354-b106-474e-b244-e0b4cc424e16 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:36.673438 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 842/1675] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:36.689128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10e27e-00d2-403b-9429-72aff89725e3 service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:36.689502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 834/1676] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:36.739112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10e27e-00d2-403b-9429-72aff89725e3 service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:36.759407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a3c69-8afd-4457-afca-8a5ded26b3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:36.760574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a3c69-8afd-4457-afca-8a5ded26b3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:36.761047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a3c69-8afd-4457-afca-8a5ded26b3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:36.761459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a3c69-8afd-4457-afca-8a5ded26b3dd admin admin] PATH_INFO: `/v3/projects/8a3ba08392bc448c9fc7d4ce08780b48/users/81b74359be274941ac8aa82a9d4b6d08/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:36.764259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a3c69-8afd-4457-afca-8a5ded26b3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3ba08392bc448c9fc7d4ce08780b48, user_id=81b74359be274941ac8aa82a9d4b6d08, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:36.767574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a3c69-8afd-4457-afca-8a5ded26b3dd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:36.785849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 843/1677] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:36 2022] PUT /identity/v3/projects/8a3ba08392bc448c9fc7d4ce08780b48/users/81b74359be274941ac8aa82a9d4b6d08/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:36.796940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e554-fb18-413f-93c8-fc38c444750e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:36.797413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e554-fb18-413f-93c8-fc38c444750e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:36.797791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7e554-fb18-413f-93c8-fc38c444750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:36.841465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-50d7e554-fb18-413f-93c8-fc38c444750e None None] MFA Rules not processed for user `81b74359be274941ac8aa82a9d4b6d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:36.843697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-50d7e554-fb18-413f-93c8-fc38c444750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:36.864987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:37.020616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 835/1678] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:37.036636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a3c69-8afd-4457-afca-8a5ded26b3dd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:37.039208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a11a3c69-8afd-4457-afca-8a5ded26b3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:37.163811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a3c69-8afd-4457-afca-8a5ded26b3dd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:37.192239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7e554-fb18-413f-93c8-fc38c444750e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:37.207525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ea3e3-86ef-472e-a55b-ba6cea7327cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:37.210431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea3e3-86ef-472e-a55b-ba6cea7327cc service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:37.210944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea3e3-86ef-472e-a55b-ba6cea7327cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:37.211431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea3e3-86ef-472e-a55b-ba6cea7327cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:37.234412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ea3e3-86ef-472e-a55b-ba6cea7327cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:37.238978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ea3e3-86ef-472e-a55b-ba6cea7327cc service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:37.248089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:37.265542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 844/1679] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:37.307525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7e554-fb18-413f-93c8-fc38c444750e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:37.313079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:37.314264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:37.314794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:37.315171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] PATH_INFO: `/v3/users/fa353b90c16b4c55a440ea1b75235679` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:37.316566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa353b90c16b4c55a440ea1b75235679)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:37.319013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:37.453074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa353b90c16b4c55a440ea1b75235679'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:37.453871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa353b90c16b4c55a440ea1b75235679'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:37.455635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa353b90c16b4c55a440ea1b75235679'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:37.470869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa353b90c16b4c55a440ea1b75235679'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:37.479412 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa353b90c16b4c55a440ea1b75235679'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:37.505663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09b225-ec73-4d1b-82c9-6d6f81f57735 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:37.506201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09b225-ec73-4d1b-82c9-6d6f81f57735 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:37.506671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09b225-ec73-4d1b-82c9-6d6f81f57735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:37.510807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 836/1680] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:37 2022] DELETE /identity/v3/users/fa353b90c16b4c55a440ea1b75235679 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:37.531682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ad09b225-ec73-4d1b-82c9-6d6f81f57735 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:37.533397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ad09b225-ec73-4d1b-82c9-6d6f81f57735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:37.633522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 845/1681] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:37.652822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:37.652998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09b225-ec73-4d1b-82c9-6d6f81f57735 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:37.654206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:37.654639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ad09b225-ec73-4d1b-82c9-6d6f81f57735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:37.676789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09b225-ec73-4d1b-82c9-6d6f81f57735 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:37.689162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:37.691371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:37.692419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:37.693468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] PATH_INFO: `/v3/users/894d34c3c126400fbbef47bb43379ed4` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:37.695794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=894d34c3c126400fbbef47bb43379ed4)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:37.701493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:37.775881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:37.853736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733138a-c582-4dd4-af31-378971fbf7c8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:37.868613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531422c-a5e3-4acc-ac69-528721ea6ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:37.869391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531422c-a5e3-4acc-ac69-528721ea6ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:37.869665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531422c-a5e3-4acc-ac69-528721ea6ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:37.869943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531422c-a5e3-4acc-ac69-528721ea6ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:37.888340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531422c-a5e3-4acc-ac69-528721ea6ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:37.889886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531422c-a5e3-4acc-ac69-528721ea6ab7 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:37.919030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894d34c3c126400fbbef47bb43379ed4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:37.922986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 837/1682] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:37.925580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894d34c3c126400fbbef47bb43379ed4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:37.966659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894d34c3c126400fbbef47bb43379ed4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:37.997048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894d34c3c126400fbbef47bb43379ed4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:38.000457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-230d1512-f7ac-4d72-95fe-9de70d777fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894d34c3c126400fbbef47bb43379ed4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:38.013607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393192b-5898-47d7-b4ce-955e3b4fb0ac None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:38.013907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393192b-5898-47d7-b4ce-955e3b4fb0ac None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:38.014191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393192b-5898-47d7-b4ce-955e3b4fb0ac None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:38.015680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 838/1683] 10.222.0.59 () {54 vars in 912 bytes} [Fri Jul 1 16:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:30:38.026610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c46563-5a58-4993-9316-a9046245fd43 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:38.026898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c46563-5a58-4993-9316-a9046245fd43 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:38.027514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c46563-5a58-4993-9316-a9046245fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:38.056340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 846/1684] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:37 2022] DELETE /identity/v3/users/894d34c3c126400fbbef47bb43379ed4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:38.060798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3a79-0cee-4d1f-9ad0-39dd522451a8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:38.063065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3a79-0cee-4d1f-9ad0-39dd522451a8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:38.063436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b3a79-0cee-4d1f-9ad0-39dd522451a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:38.105205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a88b3a79-0cee-4d1f-9ad0-39dd522451a8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:38.106478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a88b3a79-0cee-4d1f-9ad0-39dd522451a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:38.109268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-22c46563-5a58-4993-9316-a9046245fd43 None None] MFA Rules not processed for user `11785acde2f74ad481d1224f2a7fd296`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:38.115879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-22c46563-5a58-4993-9316-a9046245fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:38.246898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 839/1685] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:30:38.247927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c46563-5a58-4993-9316-a9046245fd43 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:38.249397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-22c46563-5a58-4993-9316-a9046245fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:38.313481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 847/1686] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:38.315849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3a79-0cee-4d1f-9ad0-39dd522451a8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:38.320313 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a88b3a79-0cee-4d1f-9ad0-39dd522451a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:38.366301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:38.419882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c46563-5a58-4993-9316-a9046245fd43 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:38.427529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:38.428426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:38.428532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:38.428774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] PATH_INFO: `/v3/projects/5ae18c4aeaa542a192a303a32cf70dde` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:38.430472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae18c4aeaa542a192a303a32cf70dde)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:38.437947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:38.519571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b3a79-0cee-4d1f-9ad0-39dd522451a8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:38.535945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b74359be274941ac8aa82a9d4b6d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3ba08392bc448c9fc7d4ce08780b48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:38.536661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:38.537036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:38.537383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:38.538878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:38.539240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:38.541431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:38.543619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae18c4aeaa542a192a303a32cf70dde', 'request_id': 'req-1a651007-5b9d-4e1d-8910-a544d5b192cd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:38.550157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae18c4aeaa542a192a303a32cf70dde', 'request_id': 'req-1a651007-5b9d-4e1d-8910-a544d5b192cd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:38.563066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae18c4aeaa542a192a303a32cf70dde', 'request_id': 'req-1a651007-5b9d-4e1d-8910-a544d5b192cd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:38.582391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 848/1687] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:38.583493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:38.584717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:38.590725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:38.590885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] The token cache is being invalidate because project 5ae18c4aeaa542a192a303a32cf70dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:38.591424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:38.595945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:38.604122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 840/1688] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:38 2022] DELETE /identity/v3/projects/5ae18c4aeaa542a192a303a32cf70dde => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:38.609254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:38.619766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:38.625670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88476c84-d9a8-465d-ad61-c574cf814e58 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:38.792230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:38.793754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:38.794227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:38.795445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:38.810434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:38.837789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:38.842148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:38.879992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 849/1689] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:38.883174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:38.891957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:38.909536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a651007-5b9d-4e1d-8910-a544d5b192cd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:38.934359 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb942f-0091-4537-aafa-1c10f53a4073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:38.942432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb942f-0091-4537-aafa-1c10f53a4073 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:38.942803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb942f-0091-4537-aafa-1c10f53a4073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:38.943090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb942f-0091-4537-aafa-1c10f53a4073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:38.968868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-45bb942f-0091-4537-aafa-1c10f53a4073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:39.112822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b2885-d136-4a7e-b78b-758a36164e01 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:39.125805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76d512-6976-4630-8f31-57e34fae28f1 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b74359be274941ac8aa82a9d4b6d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3ba08392bc448c9fc7d4ce08780b48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:39.126957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d512-6976-4630-8f31-57e34fae28f1 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:39.127459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d512-6976-4630-8f31-57e34fae28f1 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:39.127942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76d512-6976-4630-8f31-57e34fae28f1 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:39.128875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76d512-6976-4630-8f31-57e34fae28f1 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:39.131193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76d512-6976-4630-8f31-57e34fae28f1 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:39.204417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 850/1690] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:38 2022] POST /identity/v3/projects => generated 354 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:39.213418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72f9ca-3299-4dac-853d-dfa0817c0656 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:39.213777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72f9ca-3299-4dac-853d-dfa0817c0656 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:39.214059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72f9ca-3299-4dac-853d-dfa0817c0656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:39.233087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb942f-0091-4537-aafa-1c10f53a4073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:39.241049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb942f-0091-4537-aafa-1c10f53a4073 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:39.264255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cd72f9ca-3299-4dac-853d-dfa0817c0656 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:39.266482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cd72f9ca-3299-4dac-853d-dfa0817c0656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:39.289373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 841/1691] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:39.290364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb942f-0091-4537-aafa-1c10f53a4073 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:39.329596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:39.338143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb942f-0091-4537-aafa-1c10f53a4073 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:39.395732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 851/1692] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:39.398539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01282e25-4ef6-4616-9aa6-e3906b2499c8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:39.399042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01282e25-4ef6-4616-9aa6-e3906b2499c8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:39.399525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01282e25-4ef6-4616-9aa6-e3906b2499c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:39.444689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-01282e25-4ef6-4616-9aa6-e3906b2499c8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:39.449764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-01282e25-4ef6-4616-9aa6-e3906b2499c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:39.475292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 852/1693] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:39.476904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01282e25-4ef6-4616-9aa6-e3906b2499c8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:39.492012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01282e25-4ef6-4616-9aa6-e3906b2499c8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:39.505253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d208117-94b2-4bd1-80a2-4ad251636090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:39.505958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d208117-94b2-4bd1-80a2-4ad251636090 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:39.506246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d208117-94b2-4bd1-80a2-4ad251636090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:39.506651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d208117-94b2-4bd1-80a2-4ad251636090 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:39.507274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d208117-94b2-4bd1-80a2-4ad251636090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:39.507584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d208117-94b2-4bd1-80a2-4ad251636090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:39.509298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d208117-94b2-4bd1-80a2-4ad251636090 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:39.517260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb952e7-6e76-4bf5-808a-fe431fcfdc31 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b74359be274941ac8aa82a9d4b6d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3ba08392bc448c9fc7d4ce08780b48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:39.517966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb952e7-6e76-4bf5-808a-fe431fcfdc31 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:39.518257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb952e7-6e76-4bf5-808a-fe431fcfdc31 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:39.518537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb952e7-6e76-4bf5-808a-fe431fcfdc31 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:39.519288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb952e7-6e76-4bf5-808a-fe431fcfdc31 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:39.519605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb952e7-6e76-4bf5-808a-fe431fcfdc31 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:39.521342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb952e7-6e76-4bf5-808a-fe431fcfdc31 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:39.535737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 842/1694] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:39.560187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 853/1695] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:30:39.564830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb952e7-6e76-4bf5-808a-fe431fcfdc31 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:39.589185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb952e7-6e76-4bf5-808a-fe431fcfdc31 tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:39.611973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7ade1-5dd6-406d-bc31-91d61ad1e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:39.619637 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7ade1-5dd6-406d-bc31-91d61ad1e907 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:39.620006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7ade1-5dd6-406d-bc31-91d61ad1e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:39.620289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7ade1-5dd6-406d-bc31-91d61ad1e907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:39.621122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7ade1-5dd6-406d-bc31-91d61ad1e907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:39.629043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7ade1-5dd6-406d-bc31-91d61ad1e907 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:39.634859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d208117-94b2-4bd1-80a2-4ad251636090 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:39.662518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d208117-94b2-4bd1-80a2-4ad251636090 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:39.676732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81b74359be274941ac8aa82a9d4b6d08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3ba08392bc448c9fc7d4ce08780b48', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:39.681326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:39.681895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:39.682353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] PATH_INFO: `/v3/projects/7526017aabf242de8f38f9fb8a32bdea` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:39.684349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7526017aabf242de8f38f9fb8a32bdea)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:39.694085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 843/1696] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:39 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:39.694302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:39.697844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7ade1-5dd6-406d-bc31-91d61ad1e907 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:39.774925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:39.842217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7526017aabf242de8f38f9fb8a32bdea', 'request_id': 'req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:39.859862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7526017aabf242de8f38f9fb8a32bdea', 'request_id': 'req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:39.883917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7526017aabf242de8f38f9fb8a32bdea', 'request_id': 'req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:39.890364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7ade1-5dd6-406d-bc31-91d61ad1e907 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:40.008428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c301db8-ed6b-44fd-b1ac-1320757b9f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:40.009941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c301db8-ed6b-44fd-b1ac-1320757b9f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:40.010332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c301db8-ed6b-44fd-b1ac-1320757b9f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:40.010708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c301db8-ed6b-44fd-b1ac-1320757b9f76 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:40.011539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c301db8-ed6b-44fd-b1ac-1320757b9f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:40.014068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c301db8-ed6b-44fd-b1ac-1320757b9f76 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:40.048871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 844/1697] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:39 2022] POST /identity/v3/users => generated 283 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:40.053894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c301db8-ed6b-44fd-b1ac-1320757b9f76 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:40.067855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c301db8-ed6b-44fd-b1ac-1320757b9f76 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:40.074185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244cc11-99de-4d71-b5b2-af0c6abad46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:40.075294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244cc11-99de-4d71-b5b2-af0c6abad46b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:40.075685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244cc11-99de-4d71-b5b2-af0c6abad46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:40.076063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244cc11-99de-4d71-b5b2-af0c6abad46b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:40.076976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244cc11-99de-4d71-b5b2-af0c6abad46b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:40.079212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244cc11-99de-4d71-b5b2-af0c6abad46b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:40.097681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 845/1698] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:40.098959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244cc11-99de-4d71-b5b2-af0c6abad46b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:40.116471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244cc11-99de-4d71-b5b2-af0c6abad46b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:40.133655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026524-624a-410f-a954-b80f28395017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:40.134375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026524-624a-410f-a954-b80f28395017 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:40.134660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026524-624a-410f-a954-b80f28395017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:40.135016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026524-624a-410f-a954-b80f28395017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:40.135948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026524-624a-410f-a954-b80f28395017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:40.155643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4026524-624a-410f-a954-b80f28395017 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:40.199654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 846/1699] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:30:40.201773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026524-624a-410f-a954-b80f28395017 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:40.203481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] The token cache is being invalidate because project 7526017aabf242de8f38f9fb8a32bdea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:40.203777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:40.204466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6c15f2b3-b02d-42da-b3ef-9c2ed637582b tempest-VolumeQuotaClassesTest-1012667742 tempest-VolumeQuotaClassesTest-1012667742-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:40.209436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 854/1700] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:39 2022] DELETE /identity/v3/projects/7526017aabf242de8f38f9fb8a32bdea => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:40.253844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026524-624a-410f-a954-b80f28395017 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:40.272048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748873f2-81f4-43a6-b0ed-fb2812bbf19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:40.275841 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748873f2-81f4-43a6-b0ed-fb2812bbf19d admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:40.276111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748873f2-81f4-43a6-b0ed-fb2812bbf19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:40.281221 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748873f2-81f4-43a6-b0ed-fb2812bbf19d admin admin] PATH_INFO: `/v3/projects/fa168568cde4430a80a795cdcf8c8ff2/users/524974386e4d402b9f7c7267a4c91b23/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:40.328157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28eb1-e851-4380-9ccd-6dde09910b6a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:40.328351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28eb1-e851-4380-9ccd-6dde09910b6a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:40.328595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b28eb1-e851-4380-9ccd-6dde09910b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:40.355008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748873f2-81f4-43a6-b0ed-fb2812bbf19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa168568cde4430a80a795cdcf8c8ff2, user_id=524974386e4d402b9f7c7267a4c91b23, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:40.360001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748873f2-81f4-43a6-b0ed-fb2812bbf19d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:40.383612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-70b28eb1-e851-4380-9ccd-6dde09910b6a None None] MFA Rules not processed for user `fdc1a110d0924e759024f7cc6fc49738`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:40.384900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-70b28eb1-e851-4380-9ccd-6dde09910b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:40.413251 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 847/1701] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:40 2022] PUT /identity/v3/projects/fa168568cde4430a80a795cdcf8c8ff2/users/524974386e4d402b9f7c7267a4c91b23/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:40.414988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4026a-3f39-439d-acde-4bbf36a73b56 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:40.415179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4026a-3f39-439d-acde-4bbf36a73b56 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:40.415456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4026a-3f39-439d-acde-4bbf36a73b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:40.558219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c8a4026a-3f39-439d-acde-4bbf36a73b56 None None] MFA Rules not processed for user `524974386e4d402b9f7c7267a4c91b23`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:40.558536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 855/1702] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:30:40.560063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca235c3-aaf3-4357-8cfe-707464f8211f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:40.562145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca235c3-aaf3-4357-8cfe-707464f8211f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:40.562479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca235c3-aaf3-4357-8cfe-707464f8211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:40.569757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c8a4026a-3f39-439d-acde-4bbf36a73b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:40.608243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8ca235c3-aaf3-4357-8cfe-707464f8211f None None] MFA Rules not processed for user `fdc1a110d0924e759024f7cc6fc49738`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:40.617409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8ca235c3-aaf3-4357-8cfe-707464f8211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:40.671755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:40.798440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 856/1703] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:40.806956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca235c3-aaf3-4357-8cfe-707464f8211f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:40.809161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8ca235c3-aaf3-4357-8cfe-707464f8211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:40.949466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 848/1704] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:40.953511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4026a-3f39-439d-acde-4bbf36a73b56 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:40.960004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c8a4026a-3f39-439d-acde-4bbf36a73b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:40.982903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:41.116048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca235c3-aaf3-4357-8cfe-707464f8211f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:41.145387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97b512-8ef0-4b74-ac25-360f2764b35f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:41.146093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97b512-8ef0-4b74-ac25-360f2764b35f service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:41.148198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97b512-8ef0-4b74-ac25-360f2764b35f service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:41.148198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97b512-8ef0-4b74-ac25-360f2764b35f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:41.179779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97b512-8ef0-4b74-ac25-360f2764b35f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:41.182000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97b512-8ef0-4b74-ac25-360f2764b35f service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:41.198770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4026a-3f39-439d-acde-4bbf36a73b56 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:41.207538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 857/1705] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:41.210847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:41.211980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:41.212460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:41.212934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] PATH_INFO: `/v3/projects/0d3de5f0a37244158b5c735dc2ca2dd2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:41.216416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3de5f0a37244158b5c735dc2ca2dd2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:41.219434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:41.222707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97b512-8ef0-4b74-ac25-360f2764b35f service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:41.226322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ae97b512-8ef0-4b74-ac25-360f2764b35f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:41.265382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97b512-8ef0-4b74-ac25-360f2764b35f service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:41.299948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef4e64-3c48-42d1-9869-90e51bf27195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:41.300646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef4e64-3c48-42d1-9869-90e51bf27195 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:41.300983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef4e64-3c48-42d1-9869-90e51bf27195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:41.301268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef4e64-3c48-42d1-9869-90e51bf27195 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:41.319649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef4e64-3c48-42d1-9869-90e51bf27195 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:41.327814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef4e64-3c48-42d1-9869-90e51bf27195 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:41.349182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3de5f0a37244158b5c735dc2ca2dd2', 'request_id': 'req-3d553c0f-4838-4713-903a-549b6edfa951'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:41.358172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3de5f0a37244158b5c735dc2ca2dd2', 'request_id': 'req-3d553c0f-4838-4713-903a-549b6edfa951'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:41.391815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3de5f0a37244158b5c735dc2ca2dd2', 'request_id': 'req-3d553c0f-4838-4713-903a-549b6edfa951'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:41.421985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] The token cache is being invalidate because project 0d3de5f0a37244158b5c735dc2ca2dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:41.422529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:41.425022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:41.432387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 849/1706] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:40 2022] DELETE /identity/v3/projects/0d3de5f0a37244158b5c735dc2ca2dd2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:41.434570 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:41.440762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:41.446099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 858/1707] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:41 2022] POST /identity/v3/projects => generated 363 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:41.463612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37211a56-55db-4892-86dd-9e13e9d4ee76 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:41.468983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37211a56-55db-4892-86dd-9e13e9d4ee76 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:41.469688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37211a56-55db-4892-86dd-9e13e9d4ee76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:41.572961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-37211a56-55db-4892-86dd-9e13e9d4ee76 None None] MFA Rules not processed for user `94e69d561087490eb018178c3af5bc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:41.574525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-37211a56-55db-4892-86dd-9e13e9d4ee76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:41.656058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d553c0f-4838-4713-903a-549b6edfa951 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:41.696822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 859/1708] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:41.700626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d70ef1-650d-46fe-9513-261eb560c470 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:41.701928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d70ef1-650d-46fe-9513-261eb560c470 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:41.702196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d70ef1-650d-46fe-9513-261eb560c470 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:41.706517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 860/1709] 10.222.0.59 () {54 vars in 960 bytes} [Fri Jul 1 16:30:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:30:41.707619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4efe91-0b0e-46fb-bdba-32e2c8adf667 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:41.710721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4efe91-0b0e-46fb-bdba-32e2c8adf667 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:41.710721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4efe91-0b0e-46fb-bdba-32e2c8adf667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:41.760293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ba4efe91-0b0e-46fb-bdba-32e2c8adf667 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:41.766555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ba4efe91-0b0e-46fb-bdba-32e2c8adf667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:41.791674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:41.818310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:41.851109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:41.853826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:41.854112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:41.854388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] PATH_INFO: `/v3/users/abb98110d5464ef9bd8997b7b8a9e814` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:41.859508 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb98110d5464ef9bd8997b7b8a9e814)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:41.864975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:41.934416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 861/1710] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:41.935578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4efe91-0b0e-46fb-bdba-32e2c8adf667 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:41.941645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ba4efe91-0b0e-46fb-bdba-32e2c8adf667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:41.963706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4efe91-0b0e-46fb-bdba-32e2c8adf667 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:41.977131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798417-127b-46d1-a2ff-2b64117477f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:41.977843 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798417-127b-46d1-a2ff-2b64117477f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:41.978119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798417-127b-46d1-a2ff-2b64117477f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:41.978386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798417-127b-46d1-a2ff-2b64117477f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:41.981580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb98110d5464ef9bd8997b7b8a9e814'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:41.981728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a798417-127b-46d1-a2ff-2b64117477f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:41.982269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb98110d5464ef9bd8997b7b8a9e814'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:41.982815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb98110d5464ef9bd8997b7b8a9e814'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:41.987038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a798417-127b-46d1-a2ff-2b64117477f7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:42.013587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb98110d5464ef9bd8997b7b8a9e814'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:42.027753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 862/1711] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:41 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:42.037595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e196e32-6efd-4108-b3d4-147e4b5dc0e7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.037888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e196e32-6efd-4108-b3d4-147e4b5dc0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.038164 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e196e32-6efd-4108-b3d4-147e4b5dc0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.046640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9c7a46e7-6b7e-4662-b533-9cebdfb402aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb98110d5464ef9bd8997b7b8a9e814'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:42.079092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 850/1712] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:41 2022] DELETE /identity/v3/users/abb98110d5464ef9bd8997b7b8a9e814 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:42.081175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daa371-d386-40d7-aebf-513ce4cde8a0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.081821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daa371-d386-40d7-aebf-513ce4cde8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.097114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daa371-d386-40d7-aebf-513ce4cde8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.119624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1e196e32-6efd-4108-b3d4-147e4b5dc0e7 None None] MFA Rules not processed for user `5d773059c4b34e3e9c19e8355093266f`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:42.121708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1e196e32-6efd-4108-b3d4-147e4b5dc0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.134250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b4daa371-d386-40d7-aebf-513ce4cde8a0 None None] MFA Rules not processed for user `eb3ded7163fa400399d1b09079a366ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:42.136335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b4daa371-d386-40d7-aebf-513ce4cde8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.258729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 863/1713] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:42.260379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e196e32-6efd-4108-b3d4-147e4b5dc0e7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:42.262142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1e196e32-6efd-4108-b3d4-147e4b5dc0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.304604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 851/1714] 10.222.0.59 () {58 vars in 1057 bytes} [Fri Jul 1 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:42.305604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daa371-d386-40d7-aebf-513ce4cde8a0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:42.308148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b4daa371-d386-40d7-aebf-513ce4cde8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.404313 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e196e32-6efd-4108-b3d4-147e4b5dc0e7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:42.409486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:42.418719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e7ea0-39e3-4844-9ed8-38773b4725c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:42.419108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e7ea0-39e3-4844-9ed8-38773b4725c9 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.419385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e7ea0-39e3-4844-9ed8-38773b4725c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.419662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e7ea0-39e3-4844-9ed8-38773b4725c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.422595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daa371-d386-40d7-aebf-513ce4cde8a0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:42.425230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-150e7ea0-39e3-4844-9ed8-38773b4725c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.432064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:42.433223 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.433527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.433791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] PATH_INFO: `/v3/projects/8b70f74faf984dd5bec5e1b5c4f7d1c2` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.449717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b70f74faf984dd5bec5e1b5c4f7d1c2)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:42.461947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:42.533603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:42.571937 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e7ea0-39e3-4844-9ed8-38773b4725c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:42.574336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e7ea0-39e3-4844-9ed8-38773b4725c9 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:42.591363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b70f74faf984dd5bec5e1b5c4f7d1c2', 'request_id': 'req-408dda3c-732d-4a30-8190-998fe244834d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:42.593317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 864/1715] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:42.597501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b34b8-4084-43f5-9e22-020a5bc48227 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.597869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b34b8-4084-43f5-9e22-020a5bc48227 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.598218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b34b8-4084-43f5-9e22-020a5bc48227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.602599 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b70f74faf984dd5bec5e1b5c4f7d1c2', 'request_id': 'req-408dda3c-732d-4a30-8190-998fe244834d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:42.618548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b70f74faf984dd5bec5e1b5c4f7d1c2', 'request_id': 'req-408dda3c-732d-4a30-8190-998fe244834d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:42.621934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-528b34b8-4084-43f5-9e22-020a5bc48227 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:42.623551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-528b34b8-4084-43f5-9e22-020a5bc48227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.645100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] The token cache is being invalidate because project 8b70f74faf984dd5bec5e1b5c4f7d1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:42.645370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:42.647026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:42.654090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 852/1716] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:42 2022] DELETE /identity/v3/projects/8b70f74faf984dd5bec5e1b5c4f7d1c2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:42.655824 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:42.657518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.725824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 865/1717] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:42.726363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bb055-d26e-4a74-8b7f-17ab3f01f25f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.726930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bb055-d26e-4a74-8b7f-17ab3f01f25f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.727218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bb055-d26e-4a74-8b7f-17ab3f01f25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.762768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5e2bb055-d26e-4a74-8b7f-17ab3f01f25f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:42.765993 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5e2bb055-d26e-4a74-8b7f-17ab3f01f25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.783063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408dda3c-732d-4a30-8190-998fe244834d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:42.787269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 866/1718] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:42.789293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f485584-3e2b-4d25-b783-441bc89f8d30 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.789585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f485584-3e2b-4d25-b783-441bc89f8d30 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.790070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f485584-3e2b-4d25-b783-441bc89f8d30 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.791900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 867/1719] 10.222.0.59 () {54 vars in 912 bytes} [Fri Jul 1 16:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:30:42.792792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f485584-3e2b-4d25-b783-441bc89f8d30 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:42.794710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4f485584-3e2b-4d25-b783-441bc89f8d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.807998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93344a00-5232-449f-917a-37f45e6bfae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:42.808887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93344a00-5232-449f-917a-37f45e6bfae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.809398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93344a00-5232-449f-917a-37f45e6bfae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.809863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93344a00-5232-449f-917a-37f45e6bfae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.811406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93344a00-5232-449f-917a-37f45e6bfae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:42.815417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93344a00-5232-449f-917a-37f45e6bfae9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:42.857234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 853/1720] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:42.860723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561766f-3959-45a8-985f-bf2423a0c4d6 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.861774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561766f-3959-45a8-985f-bf2423a0c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.863754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561766f-3959-45a8-985f-bf2423a0c4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.909640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c561766f-3959-45a8-985f-bf2423a0c4d6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:42.912972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c561766f-3959-45a8-985f-bf2423a0c4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.938201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 854/1721] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:42.943908 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f485584-3e2b-4d25-b783-441bc89f8d30 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:42.946467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561766f-3959-45a8-985f-bf2423a0c4d6 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:42.954380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb897128-5835-4ded-a01c-8a10ac7050dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:42.955558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb897128-5835-4ded-a01c-8a10ac7050dd service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.955840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb897128-5835-4ded-a01c-8a10ac7050dd service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.956135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb897128-5835-4ded-a01c-8a10ac7050dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.959140 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fb897128-5835-4ded-a01c-8a10ac7050dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:42.971103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561766f-3959-45a8-985f-bf2423a0c4d6 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:42.988155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb897128-5835-4ded-a01c-8a10ac7050dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:42.989513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:42.990493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:42.990659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb897128-5835-4ded-a01c-8a10ac7050dd service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:42.990962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:42.991342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:42.992187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:42.992796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:42.994563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:43.004750 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 868/1722] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:43.007634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e025d6-80ae-497a-854e-ac73c33724c4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:43.008094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e025d6-80ae-497a-854e-ac73c33724c4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:43.008525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e025d6-80ae-497a-854e-ac73c33724c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:43.039659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f2e025d6-80ae-497a-854e-ac73c33724c4 None None] MFA Rules not processed for user `11785acde2f74ad481d1224f2a7fd296`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:43.041348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f2e025d6-80ae-497a-854e-ac73c33724c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:43.059776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 855/1723] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:43.060876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:43.069609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:43.152516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 869/1724] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:43.153365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e025d6-80ae-497a-854e-ac73c33724c4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:43.155516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f2e025d6-80ae-497a-854e-ac73c33724c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:43.183366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:43.262871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96746c8d-c7bf-4ebc-a542-18341f0d7c9c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:43.273742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c320e-ac2e-4d0f-8f83-e0962615af7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:43.275848 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c320e-ac2e-4d0f-8f83-e0962615af7d service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:43.275848 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c320e-ac2e-4d0f-8f83-e0962615af7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:43.277559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c320e-ac2e-4d0f-8f83-e0962615af7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:43.299595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c320e-ac2e-4d0f-8f83-e0962615af7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:43.306505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c320e-ac2e-4d0f-8f83-e0962615af7d service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:43.346692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 856/1725] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:43.350125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c320e-ac2e-4d0f-8f83-e0962615af7d service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:43.357695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e025d6-80ae-497a-854e-ac73c33724c4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:43.366875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:43.374352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced3522-0af0-4bb9-b8d4-ca9db42a1ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:43.375605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced3522-0af0-4bb9-b8d4-ca9db42a1ab3 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:43.376521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c320e-ac2e-4d0f-8f83-e0962615af7d service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:43.376946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced3522-0af0-4bb9-b8d4-ca9db42a1ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:43.377322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ced3522-0af0-4bb9-b8d4-ca9db42a1ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:43.382516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9ced3522-0af0-4bb9-b8d4-ca9db42a1ab3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:43.389144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75400d-e7b2-48e4-bdd6-8ce208e736a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:43.391866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75400d-e7b2-48e4-bdd6-8ce208e736a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:43.392258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75400d-e7b2-48e4-bdd6-8ce208e736a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:43.393334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75400d-e7b2-48e4-bdd6-8ce208e736a6 admin admin] PATH_INFO: `/v3/projects/179e7ff30f0b4ba49a4a5ebd20016742/users/600805e7799646e49b85ae1d446871fb/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:43.487264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75400d-e7b2-48e4-bdd6-8ce208e736a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=179e7ff30f0b4ba49a4a5ebd20016742, user_id=600805e7799646e49b85ae1d446871fb, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:43.491721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75400d-e7b2-48e4-bdd6-8ce208e736a6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:43.562103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 857/1726] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:43 2022] PUT /identity/v3/projects/179e7ff30f0b4ba49a4a5ebd20016742/users/600805e7799646e49b85ae1d446871fb/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:43.569245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c2b98-56c2-4b65-baf1-03842e9b518e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:43.573485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c2b98-56c2-4b65-baf1-03842e9b518e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:43.576685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c2b98-56c2-4b65-baf1-03842e9b518e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:43.659887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0b5c2b98-56c2-4b65-baf1-03842e9b518e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:43.662530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0b5c2b98-56c2-4b65-baf1-03842e9b518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:43.686365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced3522-0af0-4bb9-b8d4-ca9db42a1ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:43.688063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ced3522-0af0-4bb9-b8d4-ca9db42a1ab3 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:43.729218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 870/1727] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:43.730171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced3522-0af0-4bb9-b8d4-ca9db42a1ab3 service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:43.764344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ced3522-0af0-4bb9-b8d4-ca9db42a1ab3 service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:44.016719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9229e-a402-4e97-9367-14e2ada83594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:44.019506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9229e-a402-4e97-9367-14e2ada83594 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:44.020141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9229e-a402-4e97-9367-14e2ada83594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:44.022714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9229e-a402-4e97-9367-14e2ada83594 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:44.023643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9229e-a402-4e97-9367-14e2ada83594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:44.029440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9229e-a402-4e97-9367-14e2ada83594 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:44.086634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 858/1728] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:44.088148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c2b98-56c2-4b65-baf1-03842e9b518e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:44.095070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 871/1729] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:43 2022] POST /identity/v3/projects => generated 391 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:44.096487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9229e-a402-4e97-9367-14e2ada83594 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:44.164705 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:44.235342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9229e-a402-4e97-9367-14e2ada83594 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:44.249325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233753b-dc63-4bec-88b6-212dd1c92f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:44.250483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233753b-dc63-4bec-88b6-212dd1c92f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:44.251016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233753b-dc63-4bec-88b6-212dd1c92f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:44.265386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233753b-dc63-4bec-88b6-212dd1c92f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:44.266419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233753b-dc63-4bec-88b6-212dd1c92f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:44.272335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c2b98-56c2-4b65-baf1-03842e9b518e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:44.273380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233753b-dc63-4bec-88b6-212dd1c92f1a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:44.301458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 872/1730] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:44.302639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233753b-dc63-4bec-88b6-212dd1c92f1a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:44.349750 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233753b-dc63-4bec-88b6-212dd1c92f1a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:44.375782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a05ca9-d526-40aa-9253-3219a95dd4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:44.376402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a05ca9-d526-40aa-9253-3219a95dd4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:44.376718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a05ca9-d526-40aa-9253-3219a95dd4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:44.377316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a05ca9-d526-40aa-9253-3219a95dd4e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:44.377878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a05ca9-d526-40aa-9253-3219a95dd4e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:44.378187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a05ca9-d526-40aa-9253-3219a95dd4e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:44.380023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a05ca9-d526-40aa-9253-3219a95dd4e1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:44.429849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 873/1731] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:44.429849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a05ca9-d526-40aa-9253-3219a95dd4e1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:44.453396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a05ca9-d526-40aa-9253-3219a95dd4e1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:44.464836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e316737-2cfd-482e-be0c-67a3fcaae579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:44.466348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e316737-2cfd-482e-be0c-67a3fcaae579 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:44.466840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e316737-2cfd-482e-be0c-67a3fcaae579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:44.467278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e316737-2cfd-482e-be0c-67a3fcaae579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:44.468144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c179a-7319-4940-a9aa-83799851c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:44.469409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c179a-7319-4940-a9aa-83799851c966 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:44.469732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c179a-7319-4940-a9aa-83799851c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:44.473772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c179a-7319-4940-a9aa-83799851c966 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:44.479615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c179a-7319-4940-a9aa-83799851c966 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:44.482918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c179a-7319-4940-a9aa-83799851c966 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:44.494869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e316737-2cfd-482e-be0c-67a3fcaae579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:44.498572 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e316737-2cfd-482e-be0c-67a3fcaae579 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:44.521554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 859/1732] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:44.525254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e316737-2cfd-482e-be0c-67a3fcaae579 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:44.526044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 874/1733] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:44 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:44.527117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c179a-7319-4940-a9aa-83799851c966 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:44.572503 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c179a-7319-4940-a9aa-83799851c966 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:44.572729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e316737-2cfd-482e-be0c-67a3fcaae579 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:44.604465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e89c6-e2b6-48a6-b9b8-897af0ef2fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:44.607437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad628c-d253-4bdb-a655-b4b3dec4763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:44.608337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e89c6-e2b6-48a6-b9b8-897af0ef2fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:44.608657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e89c6-e2b6-48a6-b9b8-897af0ef2fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:44.612092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541e89c6-e2b6-48a6-b9b8-897af0ef2fbe admin admin] PATH_INFO: `/v3/projects/179e7ff30f0b4ba49a4a5ebd20016742/users/600805e7799646e49b85ae1d446871fb/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:44.612456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad628c-d253-4bdb-a655-b4b3dec4763a admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:44.613789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad628c-d253-4bdb-a655-b4b3dec4763a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:44.614071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad628c-d253-4bdb-a655-b4b3dec4763a admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:44.614789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad628c-d253-4bdb-a655-b4b3dec4763a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:44.617749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e89c6-e2b6-48a6-b9b8-897af0ef2fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=179e7ff30f0b4ba49a4a5ebd20016742, user_id=600805e7799646e49b85ae1d446871fb, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:44.619394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad628c-d253-4bdb-a655-b4b3dec4763a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:44.629492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541e89c6-e2b6-48a6-b9b8-897af0ef2fbe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:44.657204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 860/1734] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:44 2022] PUT /identity/v3/projects/179e7ff30f0b4ba49a4a5ebd20016742/users/600805e7799646e49b85ae1d446871fb/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:44.659574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e89c6-e2b6-48a6-b9b8-897af0ef2fbe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:44.732293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:44.744078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 875/1735] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:44 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:44.753711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e50665-bd50-4707-8c06-9bce7205efe1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:44.754015 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e50665-bd50-4707-8c06-9bce7205efe1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:44.754287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e50665-bd50-4707-8c06-9bce7205efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:44.858932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-65e50665-bd50-4707-8c06-9bce7205efe1 None None] MFA Rules not processed for user `600805e7799646e49b85ae1d446871fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:44.860572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-65e50665-bd50-4707-8c06-9bce7205efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:44.861624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541e89c6-e2b6-48a6-b9b8-897af0ef2fbe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:45.097379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421c4aa-e9c6-4170-b9c7-72261815db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:45.098415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421c4aa-e9c6-4170-b9c7-72261815db06 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:45.099940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421c4aa-e9c6-4170-b9c7-72261815db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:45.099940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421c4aa-e9c6-4170-b9c7-72261815db06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:45.100181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421c4aa-e9c6-4170-b9c7-72261815db06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:45.104525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421c4aa-e9c6-4170-b9c7-72261815db06 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:45.119787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 861/1736] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:45.120827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421c4aa-e9c6-4170-b9c7-72261815db06 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:45.125360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f421c4aa-e9c6-4170-b9c7-72261815db06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:45.147530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 876/1737] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:44 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:45.147666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421c4aa-e9c6-4170-b9c7-72261815db06 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:45.149779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e50665-bd50-4707-8c06-9bce7205efe1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:45.167590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:45.173949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:45.174255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:45.174602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] PATH_INFO: `/v3/projects/1f9b91267bd74b8d9a8a272cf246ef75` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:45.178877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9b91267bd74b8d9a8a272cf246ef75)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:45.185348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:45.192173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e50665-bd50-4707-8c06-9bce7205efe1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:45.207075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433167d3-c1e4-48f9-bc47-22b152266ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:45.208044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433167d3-c1e4-48f9-bc47-22b152266ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:45.208443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433167d3-c1e4-48f9-bc47-22b152266ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:45.211107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433167d3-c1e4-48f9-bc47-22b152266ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:45.213353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433167d3-c1e4-48f9-bc47-22b152266ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:45.216417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433167d3-c1e4-48f9-bc47-22b152266ee9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:45.280207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 877/1738] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:45 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:45.283955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433167d3-c1e4-48f9-bc47-22b152266ee9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:45.286550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9b91267bd74b8d9a8a272cf246ef75', 'request_id': 'req-382dc6e3-c1cc-41e6-b3d4-28257f579c77'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.304335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9b91267bd74b8d9a8a272cf246ef75', 'request_id': 'req-382dc6e3-c1cc-41e6-b3d4-28257f579c77'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.309439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433167d3-c1e4-48f9-bc47-22b152266ee9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:45.330818 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9b91267bd74b8d9a8a272cf246ef75', 'request_id': 'req-382dc6e3-c1cc-41e6-b3d4-28257f579c77'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.358899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] The token cache is being invalidate because project 1f9b91267bd74b8d9a8a272cf246ef75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:45.359789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.360411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.363214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 862/1739] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:45 2022] DELETE /identity/v3/projects/1f9b91267bd74b8d9a8a272cf246ef75 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:45.364291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:45.367490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:45.442038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:45.504434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f730ea-536e-4659-a4e2-58ab5636d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:45.505089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f730ea-536e-4659-a4e2-58ab5636d255 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:45.505368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f730ea-536e-4659-a4e2-58ab5636d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:45.505638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f730ea-536e-4659-a4e2-58ab5636d255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:45.506372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f730ea-536e-4659-a4e2-58ab5636d255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:45.513426 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f730ea-536e-4659-a4e2-58ab5636d255 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:45.543149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 878/1740] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:45.546495 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f730ea-536e-4659-a4e2-58ab5636d255 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:45.552972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f4f730ea-536e-4659-a4e2-58ab5636d255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:45.589307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f730ea-536e-4659-a4e2-58ab5636d255 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:45.594233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dc6e3-c1cc-41e6-b3d4-28257f579c77 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:45.607861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:45.609097 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:45.609542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:45.610060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:45.612089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70347a9-90ed-40e9-a33b-5897ca859bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:45.613587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:45.614981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70347a9-90ed-40e9-a33b-5897ca859bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:45.615266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70347a9-90ed-40e9-a33b-5897ca859bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:45.615682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70347a9-90ed-40e9-a33b-5897ca859bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:45.617977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70347a9-90ed-40e9-a33b-5897ca859bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:45.624258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70347a9-90ed-40e9-a33b-5897ca859bb0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:45.634972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:45.658490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 879/1741] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:45.665754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70347a9-90ed-40e9-a33b-5897ca859bb0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:45.671416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d70347a9-90ed-40e9-a33b-5897ca859bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:45.695824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70347a9-90ed-40e9-a33b-5897ca859bb0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:45.701338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:45.702328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:45.702876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:45.703228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] PATH_INFO: `/v3/users/81b74359be274941ac8aa82a9d4b6d08` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:45.705147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b74359be274941ac8aa82a9d4b6d08)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:45.707369 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:45.811225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b74359be274941ac8aa82a9d4b6d08'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.811225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b74359be274941ac8aa82a9d4b6d08'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.833972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:45.835507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:45.853569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b74359be274941ac8aa82a9d4b6d08'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.881012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b74359be274941ac8aa82a9d4b6d08'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.882431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 863/1742] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:45 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:45.884177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:45.895862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b74359be274941ac8aa82a9d4b6d08'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:45.906110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:45.925491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 880/1743] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:45 2022] DELETE /identity/v3/users/81b74359be274941ac8aa82a9d4b6d08 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:45.925491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:45.925491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:45.963035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4b432-8166-4e20-aa12-15fbe0fc7da0 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:46.037076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01120-e734-43b8-8210-b2351f5ac9ab admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:46.043533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fb820-371d-4dee-97a0-600aef0cf959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:46.044419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fb820-371d-4dee-97a0-600aef0cf959 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:46.044861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fb820-371d-4dee-97a0-600aef0cf959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:46.045265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fb820-371d-4dee-97a0-600aef0cf959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:46.046308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fb820-371d-4dee-97a0-600aef0cf959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:46.048950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fb820-371d-4dee-97a0-600aef0cf959 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:46.091478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 881/1744] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:46.091926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fb820-371d-4dee-97a0-600aef0cf959 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:46.155139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fb820-371d-4dee-97a0-600aef0cf959 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:46.167905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9a222-307a-41f3-926b-a7e330c8d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:46.170280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9a222-307a-41f3-926b-a7e330c8d970 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:46.170583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9a222-307a-41f3-926b-a7e330c8d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:46.174525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9a222-307a-41f3-926b-a7e330c8d970 admin admin] PATH_INFO: `/v3/projects/d71c4a83914946ad94dcdaa847c583fe/users/e8ba5aab06174901b7647ccbef537421/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:46.219768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9a222-307a-41f3-926b-a7e330c8d970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71c4a83914946ad94dcdaa847c583fe, user_id=e8ba5aab06174901b7647ccbef537421, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:46.233315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9a222-307a-41f3-926b-a7e330c8d970 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:46.235334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568e603-8e28-4704-bb9e-947cfb321196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:46.236305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e603-8e28-4704-bb9e-947cfb321196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:46.236531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e603-8e28-4704-bb9e-947cfb321196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:46.236932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568e603-8e28-4704-bb9e-947cfb321196 admin admin] PATH_INFO: `/v3/projects/7081e080e9b04f788d50a8d6490afd3c/users/951750b2d18443019271b2b2bf8ad9ba/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:46.281810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568e603-8e28-4704-bb9e-947cfb321196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7081e080e9b04f788d50a8d6490afd3c, user_id=951750b2d18443019271b2b2bf8ad9ba, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:46.287245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568e603-8e28-4704-bb9e-947cfb321196 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:46.291516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 882/1745] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:46 2022] PUT /identity/v3/projects/d71c4a83914946ad94dcdaa847c583fe/users/e8ba5aab06174901b7647ccbef537421/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:46.305992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce3aa-3068-4069-bfbb-ad17372c4051 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:46.306665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce3aa-3068-4069-bfbb-ad17372c4051 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:46.306954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ce3aa-3068-4069-bfbb-ad17372c4051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:46.355463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 864/1746] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:45 2022] PUT /identity/v3/projects/7081e080e9b04f788d50a8d6490afd3c/users/951750b2d18443019271b2b2bf8ad9ba/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:46.357416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74c0b8-16de-4b26-8768-76e9d0593766 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:46.357811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74c0b8-16de-4b26-8768-76e9d0593766 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:46.358095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74c0b8-16de-4b26-8768-76e9d0593766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:46.370201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:46.397290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-872ce3aa-3068-4069-bfbb-ad17372c4051 None None] MFA Rules not processed for user `e8ba5aab06174901b7647ccbef537421`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:46.404208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-872ce3aa-3068-4069-bfbb-ad17372c4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:46.517452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4c74c0b8-16de-4b26-8768-76e9d0593766 None None] MFA Rules not processed for user `951750b2d18443019271b2b2bf8ad9ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:46.520713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4c74c0b8-16de-4b26-8768-76e9d0593766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:46.778714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 883/1747] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:30:46.783273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce3aa-3068-4069-bfbb-ad17372c4051 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:46.851587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 865/1748] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:46.858833 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74c0b8-16de-4b26-8768-76e9d0593766 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:46.868622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4c74c0b8-16de-4b26-8768-76e9d0593766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:46.998384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:47.119836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ce3aa-3068-4069-bfbb-ad17372c4051 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:47.135892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15da9d-05c5-412e-8635-93b8dc25381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:47.136790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15da9d-05c5-412e-8635-93b8dc25381e admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:47.137458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15da9d-05c5-412e-8635-93b8dc25381e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:47.138128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15da9d-05c5-412e-8635-93b8dc25381e admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:47.138984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15da9d-05c5-412e-8635-93b8dc25381e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:47.151472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15da9d-05c5-412e-8635-93b8dc25381e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:47.153082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74c0b8-16de-4b26-8768-76e9d0593766 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:47.162767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6f79d-b2c2-44c9-82d9-ca42793c7f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:47.163626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6f79d-b2c2-44c9-82d9-ca42793c7f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:47.164013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6f79d-b2c2-44c9-82d9-ca42793c7f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:47.164453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6f79d-b2c2-44c9-82d9-ca42793c7f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:47.165335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6f79d-b2c2-44c9-82d9-ca42793c7f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:47.168010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6f79d-b2c2-44c9-82d9-ca42793c7f45 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:47.265391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 866/1749] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:46 2022] POST /identity/v3/projects => generated 389 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:47.266375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6f79d-b2c2-44c9-82d9-ca42793c7f45 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:47.270436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ede6f79d-b2c2-44c9-82d9-ca42793c7f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:47.284082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 884/1750] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:46 2022] POST /identity/v3/projects => generated 377 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:47.284082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15da9d-05c5-412e-8635-93b8dc25381e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:47.545114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6f79d-b2c2-44c9-82d9-ca42793c7f45 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:47.559455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15da9d-05c5-412e-8635-93b8dc25381e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:47.586036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:47.586947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:47.587231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:47.587506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] PATH_INFO: `/v3/projects/8a3ba08392bc448c9fc7d4ce08780b48` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:47.598124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c624-dd25-4920-b80a-bb1d84f06ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:47.602425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3ba08392bc448c9fc7d4ce08780b48)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:47.605390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c624-dd25-4920-b80a-bb1d84f06ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:47.607640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c624-dd25-4920-b80a-bb1d84f06ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:47.608134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712c624-dd25-4920-b80a-bb1d84f06ddd admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:47.609665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712c624-dd25-4920-b80a-bb1d84f06ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:47.615951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712c624-dd25-4920-b80a-bb1d84f06ddd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:47.622418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:47.679518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 885/1751] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:47 2022] POST /identity/v3/users => generated 301 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:47.683344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c624-dd25-4920-b80a-bb1d84f06ddd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:47.741861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712c624-dd25-4920-b80a-bb1d84f06ddd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:47.759740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4822d-3858-4cd5-ac32-eb6896872b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:47.760314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4822d-3858-4cd5-ac32-eb6896872b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:47.760599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4822d-3858-4cd5-ac32-eb6896872b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:47.761293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd4822d-3858-4cd5-ac32-eb6896872b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:47.762020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4822d-3858-4cd5-ac32-eb6896872b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:47.763995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd4822d-3858-4cd5-ac32-eb6896872b14 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:47.801056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:47.839165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 886/1752] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:47 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:47.840051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4822d-3858-4cd5-ac32-eb6896872b14 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:47.842952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ccd4822d-3858-4cd5-ac32-eb6896872b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:47.852775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3ba08392bc448c9fc7d4ce08780b48', 'request_id': 'req-4ab983aa-bc67-45f0-8a0c-18947c72a811'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:47.886038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3ba08392bc448c9fc7d4ce08780b48', 'request_id': 'req-4ab983aa-bc67-45f0-8a0c-18947c72a811'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:47.901288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd4822d-3858-4cd5-ac32-eb6896872b14 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:47.911187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3ba08392bc448c9fc7d4ce08780b48', 'request_id': 'req-4ab983aa-bc67-45f0-8a0c-18947c72a811'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:47.968189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] The token cache is being invalidate because project 8a3ba08392bc448c9fc7d4ce08780b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:47.968488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:47.969280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4ab983aa-bc67-45f0-8a0c-18947c72a811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:47.986051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 867/1753] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:47 2022] DELETE /identity/v3/projects/8a3ba08392bc448c9fc7d4ce08780b48 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:47.987696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05967d-00c1-433f-bd72-32bb25043700 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:47.987992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05967d-00c1-433f-bd72-32bb25043700 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:47.988276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05967d-00c1-433f-bd72-32bb25043700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:48.074277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ea05967d-00c1-433f-bd72-32bb25043700 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:48.076975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ea05967d-00c1-433f-bd72-32bb25043700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:48.131691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:48.131691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:48.131691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:48.131691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] PATH_INFO: `/v3/users/524974386e4d402b9f7c7267a4c91b23` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:48.134183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=524974386e4d402b9f7c7267a4c91b23)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:48.136295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:48.195407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:48.284534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524974386e4d402b9f7c7267a4c91b23'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:48.285456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524974386e4d402b9f7c7267a4c91b23'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:48.303338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524974386e4d402b9f7c7267a4c91b23'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:48.312405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524974386e4d402b9f7c7267a4c91b23'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:48.314559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ac3562b1-3094-4c92-a4c5-1d8835925e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524974386e4d402b9f7c7267a4c91b23'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:48.330152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 868/1754] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:30:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:48.335640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05967d-00c1-433f-bd72-32bb25043700 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:48.340488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ea05967d-00c1-433f-bd72-32bb25043700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:48.394680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 887/1755] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:47 2022] DELETE /identity/v3/users/524974386e4d402b9f7c7267a4c91b23 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:48.394680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2194e-c37c-4da7-a593-fcaa7d839339 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:48.394990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2194e-c37c-4da7-a593-fcaa7d839339 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:48.395270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2194e-c37c-4da7-a593-fcaa7d839339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:48.429609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05967d-00c1-433f-bd72-32bb25043700 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:48.444447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-40b2194e-c37c-4da7-a593-fcaa7d839339 None None] MFA Rules not processed for user `fdc1a110d0924e759024f7cc6fc49738`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:48.445729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-40b2194e-c37c-4da7-a593-fcaa7d839339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:48.633056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716eee6-9a0e-4ec0-a1d3-2f979e6a2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:48.636675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716eee6-9a0e-4ec0-a1d3-2f979e6a2e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:48.637686 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716eee6-9a0e-4ec0-a1d3-2f979e6a2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:48.637686 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716eee6-9a0e-4ec0-a1d3-2f979e6a2e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:48.638287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716eee6-9a0e-4ec0-a1d3-2f979e6a2e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:48.644074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716eee6-9a0e-4ec0-a1d3-2f979e6a2e74 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:48.672872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 888/1756] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:48.673088 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2194e-c37c-4da7-a593-fcaa7d839339 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:48.679304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-40b2194e-c37c-4da7-a593-fcaa7d839339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:48.697009 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 869/1757] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:48.700492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faa0b5-863e-427f-9817-812671e2808f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:48.700785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faa0b5-863e-427f-9817-812671e2808f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:48.704447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faa0b5-863e-427f-9817-812671e2808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:48.759175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2194e-c37c-4da7-a593-fcaa7d839339 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:48.800636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4178af-717d-4eb4-8a60-4404a3a42aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:48.806568 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4178af-717d-4eb4-8a60-4404a3a42aea admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:48.807697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4178af-717d-4eb4-8a60-4404a3a42aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:48.807987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4178af-717d-4eb4-8a60-4404a3a42aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:48.814419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4178af-717d-4eb4-8a60-4404a3a42aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:48.818095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c9faa0b5-863e-427f-9817-812671e2808f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:48.822891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c9faa0b5-863e-427f-9817-812671e2808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:48.824254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4178af-717d-4eb4-8a60-4404a3a42aea admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:48.883618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 870/1758] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:48.900054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 889/1759] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:48.904962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c53e-0929-4698-9397-60a90f04ba1b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:48.905600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c53e-0929-4698-9397-60a90f04ba1b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:48.907599 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4c53e-0929-4698-9397-60a90f04ba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:48.908536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4178af-717d-4eb4-8a60-4404a3a42aea admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:48.942288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4178af-717d-4eb4-8a60-4404a3a42aea admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:48.961539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0032-1cb0-432a-9163-b55148312516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:48.965011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0032-1cb0-432a-9163-b55148312516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:48.965299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0032-1cb0-432a-9163-b55148312516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:48.968318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0032-1cb0-432a-9163-b55148312516 admin admin] PATH_INFO: `/v3/projects/fb2541dcdada41049e7b832fa243d8a0/users/c4e3242fd02942fd8b007c5a67c64478/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:48.971868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-71e4c53e-0929-4698-9397-60a90f04ba1b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:48.979206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-71e4c53e-0929-4698-9397-60a90f04ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:48.979499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:49.032693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 871/1760] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:49.033761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4c53e-0929-4698-9397-60a90f04ba1b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:49.036311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-71e4c53e-0929-4698-9397-60a90f04ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:49.047113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa0032-1cb0-432a-9163-b55148312516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2541dcdada41049e7b832fa243d8a0, user_id=c4e3242fd02942fd8b007c5a67c64478, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:49.057593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa0032-1cb0-432a-9163-b55148312516 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:49.100880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 890/1761] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:48 2022] PUT /identity/v3/projects/fb2541dcdada41049e7b832fa243d8a0/users/c4e3242fd02942fd8b007c5a67c64478/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:49.104721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a471a-c25d-4bb0-8e12-265f707eddf7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:49.106132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a471a-c25d-4bb0-8e12-265f707eddf7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:49.106416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a471a-c25d-4bb0-8e12-265f707eddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:49.171090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-950a471a-c25d-4bb0-8e12-265f707eddf7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:49.184257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-950a471a-c25d-4bb0-8e12-265f707eddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:49.294104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4c53e-0929-4698-9397-60a90f04ba1b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:49.389915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:49.406567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea5152-4727-4538-b6e7-94a652d123e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:49.407280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea5152-4727-4538-b6e7-94a652d123e1 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:49.407562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea5152-4727-4538-b6e7-94a652d123e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:49.407839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea5152-4727-4538-b6e7-94a652d123e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:49.422832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 891/1762] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:49.424405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a471a-c25d-4bb0-8e12-265f707eddf7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:49.454067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a471a-c25d-4bb0-8e12-265f707eddf7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:49.467273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e9473-f9d7-4652-8d66-bd49f0ef0d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:49.468877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e9473-f9d7-4652-8d66-bd49f0ef0d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:49.469586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e9473-f9d7-4652-8d66-bd49f0ef0d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:49.470052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e9473-f9d7-4652-8d66-bd49f0ef0d91 admin admin] PATH_INFO: `/v3/projects/369f115da74a4a5b82fd61ba122b5d0b/users/8e6e0491c4514d038e8863115585aaef/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:49.511007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e9473-f9d7-4652-8d66-bd49f0ef0d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=369f115da74a4a5b82fd61ba122b5d0b, user_id=8e6e0491c4514d038e8863115585aaef, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:49.514896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e9473-f9d7-4652-8d66-bd49f0ef0d91 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:49.554326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 892/1763] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:49 2022] PUT /identity/v3/projects/369f115da74a4a5b82fd61ba122b5d0b/users/8e6e0491c4514d038e8863115585aaef/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:49.558767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e9473-f9d7-4652-8d66-bd49f0ef0d91 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:49.612005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea5152-4727-4538-b6e7-94a652d123e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:49.616149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea5152-4727-4538-b6e7-94a652d123e1 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:49.637168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 872/1764] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:30:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:30:49.640347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea5152-4727-4538-b6e7-94a652d123e1 service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:49.643860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-32ea5152-4727-4538-b6e7-94a652d123e1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:49.742701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e9473-f9d7-4652-8d66-bd49f0ef0d91 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:49.763227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96d416-113f-4018-b94b-f9da650b26b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:49.767235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96d416-113f-4018-b94b-f9da650b26b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:49.767623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96d416-113f-4018-b94b-f9da650b26b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:49.769203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96d416-113f-4018-b94b-f9da650b26b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:49.772545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96d416-113f-4018-b94b-f9da650b26b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:49.777676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96d416-113f-4018-b94b-f9da650b26b5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:49.821047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 893/1765] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:49 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:49.821557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96d416-113f-4018-b94b-f9da650b26b5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:49.874908 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96d416-113f-4018-b94b-f9da650b26b5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:49.907876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4f1f-d60c-4fc0-b1b7-86dfc4d6883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:49.909781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4f1f-d60c-4fc0-b1b7-86dfc4d6883c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:49.910392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4f1f-d60c-4fc0-b1b7-86dfc4d6883c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:49.911005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa4f1f-d60c-4fc0-b1b7-86dfc4d6883c admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:49.911972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa4f1f-d60c-4fc0-b1b7-86dfc4d6883c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:30:49.914536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa4f1f-d60c-4fc0-b1b7-86dfc4d6883c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:49.934390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa4f1f-d60c-4fc0-b1b7-86dfc4d6883c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:49.994931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea5152-4727-4538-b6e7-94a652d123e1 service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:50.022841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 894/1766] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:30:50.035932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4f1f-d60c-4fc0-b1b7-86dfc4d6883c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:50.102983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa4f1f-d60c-4fc0-b1b7-86dfc4d6883c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:50.148370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14e365-26ef-4db8-b049-2bcee80cca44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:50.151138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14e365-26ef-4db8-b049-2bcee80cca44 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:50.151138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14e365-26ef-4db8-b049-2bcee80cca44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:50.151138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14e365-26ef-4db8-b049-2bcee80cca44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:50.151138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14e365-26ef-4db8-b049-2bcee80cca44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:50.198191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14e365-26ef-4db8-b049-2bcee80cca44 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:50.257571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 895/1767] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:50.258176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14e365-26ef-4db8-b049-2bcee80cca44 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:50.340772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14e365-26ef-4db8-b049-2bcee80cca44 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:50.364290 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcf846-2080-462b-a08e-97f8bcc1aea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:50.365488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcf846-2080-462b-a08e-97f8bcc1aea2 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:50.365777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcf846-2080-462b-a08e-97f8bcc1aea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:50.366058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcf846-2080-462b-a08e-97f8bcc1aea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:50.369464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce08a2-a267-4fc2-a5f1-c4c3b38f4512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:50.370395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce08a2-a267-4fc2-a5f1-c4c3b38f4512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:50.370681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce08a2-a267-4fc2-a5f1-c4c3b38f4512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:50.370963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce08a2-a267-4fc2-a5f1-c4c3b38f4512 admin admin] PATH_INFO: `/v3/projects/fb2541dcdada41049e7b832fa243d8a0/users/c4e3242fd02942fd8b007c5a67c64478/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:50.395037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce08a2-a267-4fc2-a5f1-c4c3b38f4512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2541dcdada41049e7b832fa243d8a0, user_id=c4e3242fd02942fd8b007c5a67c64478, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:50.404355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce08a2-a267-4fc2-a5f1-c4c3b38f4512 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:50.417761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcf846-2080-462b-a08e-97f8bcc1aea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:50.421733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dcf846-2080-462b-a08e-97f8bcc1aea2 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:50.457166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 896/1768] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:50 2022] PUT /identity/v3/projects/fb2541dcdada41049e7b832fa243d8a0/users/c4e3242fd02942fd8b007c5a67c64478/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:50.459728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce08a2-a267-4fc2-a5f1-c4c3b38f4512 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:50.470216 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 873/1769] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 832 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:50.474827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcf846-2080-462b-a08e-97f8bcc1aea2 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:50.508988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcf846-2080-462b-a08e-97f8bcc1aea2 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:50.547222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:50.694242 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce08a2-a267-4fc2-a5f1-c4c3b38f4512 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:50.711813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a67c79-0402-49cb-8822-73d019bd080d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:50.713409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a67c79-0402-49cb-8822-73d019bd080d admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:50.714290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a67c79-0402-49cb-8822-73d019bd080d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:50.714614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a67c79-0402-49cb-8822-73d019bd080d admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:50.716728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a67c79-0402-49cb-8822-73d019bd080d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:50.720151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a67c79-0402-49cb-8822-73d019bd080d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:50.722110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6b4b5-0974-402f-a52c-10ce7425ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:50.723614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6b4b5-0974-402f-a52c-10ce7425ac9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:50.723973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6b4b5-0974-402f-a52c-10ce7425ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:50.724284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6b4b5-0974-402f-a52c-10ce7425ac9e admin admin] PATH_INFO: `/v3/projects/369f115da74a4a5b82fd61ba122b5d0b/users/8e6e0491c4514d038e8863115585aaef/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:50.731606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6b4b5-0974-402f-a52c-10ce7425ac9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=369f115da74a4a5b82fd61ba122b5d0b, user_id=8e6e0491c4514d038e8863115585aaef, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:50.742672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6b4b5-0974-402f-a52c-10ce7425ac9e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:50.749900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:50.773840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 874/1770] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:50 2022] PUT /identity/v3/projects/369f115da74a4a5b82fd61ba122b5d0b/users/8e6e0491c4514d038e8863115585aaef/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:50.773840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea68f-bd1c-4fa7-8126-91272ffbf2d5 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:50.773840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea68f-bd1c-4fa7-8126-91272ffbf2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:50.773840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea68f-bd1c-4fa7-8126-91272ffbf2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:50.832541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 897/1771] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:50 2022] POST /identity/v3/projects => generated 383 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:50.834947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea385258-a1be-444f-8918-28c8536f2434 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:50.835236 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d42ea68f-bd1c-4fa7-8126-91272ffbf2d5 None None] MFA Rules not processed for user `c4e3242fd02942fd8b007c5a67c64478`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:50.838110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d42ea68f-bd1c-4fa7-8126-91272ffbf2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:50.839460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea385258-a1be-444f-8918-28c8536f2434 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:50.839789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea385258-a1be-444f-8918-28c8536f2434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:50.974996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ea385258-a1be-444f-8918-28c8536f2434 None None] MFA Rules not processed for user `8e6e0491c4514d038e8863115585aaef`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:50.976999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ea385258-a1be-444f-8918-28c8536f2434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:51.215244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 875/1772] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:51.216298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ea68f-bd1c-4fa7-8126-91272ffbf2d5 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:51.259384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 898/1773] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:51.260543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea385258-a1be-444f-8918-28c8536f2434 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:51.262264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ea385258-a1be-444f-8918-28c8536f2434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:51.442198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea385258-a1be-444f-8918-28c8536f2434 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:51.459781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6db19-3e00-4c50-8f80-ccbc7655d2af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:51.459781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6db19-3e00-4c50-8f80-ccbc7655d2af service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:51.460518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6db19-3e00-4c50-8f80-ccbc7655d2af service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:51.460518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6db19-3e00-4c50-8f80-ccbc7655d2af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:51.503979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6db19-3e00-4c50-8f80-ccbc7655d2af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:51.507053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6db19-3e00-4c50-8f80-ccbc7655d2af service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:51.548813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ea68f-bd1c-4fa7-8126-91272ffbf2d5 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:51.569073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee72f2e-7bc2-414d-a7fa-71ba10923164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:51.570657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee72f2e-7bc2-414d-a7fa-71ba10923164 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:51.570962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee72f2e-7bc2-414d-a7fa-71ba10923164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:51.571247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee72f2e-7bc2-414d-a7fa-71ba10923164 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:51.576418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee72f2e-7bc2-414d-a7fa-71ba10923164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:51.577308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 899/1774] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:51.578513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6db19-3e00-4c50-8f80-ccbc7655d2af service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:51.579976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee72f2e-7bc2-414d-a7fa-71ba10923164 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:51.594749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-13d6db19-3e00-4c50-8f80-ccbc7655d2af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:51.643027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6db19-3e00-4c50-8f80-ccbc7655d2af service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:51.657856 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 876/1775] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:51 2022] POST /identity/v3/users => generated 292 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:51.659941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee72f2e-7bc2-414d-a7fa-71ba10923164 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:51.666184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f5d1a-b6e3-470a-80db-c36e9863e9cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:51.671134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f5d1a-b6e3-470a-80db-c36e9863e9cd service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:51.674232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f5d1a-b6e3-470a-80db-c36e9863e9cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:51.681708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f5d1a-b6e3-470a-80db-c36e9863e9cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:51.719731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee72f2e-7bc2-414d-a7fa-71ba10923164 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:51.740623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f5d1a-b6e3-470a-80db-c36e9863e9cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:51.742377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f5d1a-b6e3-470a-80db-c36e9863e9cd service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:51.771234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1526-3bb8-4ada-9451-fe6960b7b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:51.776278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1526-3bb8-4ada-9451-fe6960b7b92f admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:51.777870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1526-3bb8-4ada-9451-fe6960b7b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:51.778309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e1526-3bb8-4ada-9451-fe6960b7b92f admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:51.785316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1526-3bb8-4ada-9451-fe6960b7b92f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:51.793203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 900/1776] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:51.794419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f5d1a-b6e3-470a-80db-c36e9863e9cd service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:51.796056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e1526-3bb8-4ada-9451-fe6960b7b92f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:51.820255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f5d1a-b6e3-470a-80db-c36e9863e9cd service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:51.839199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9c282-1be1-4b53-9b5e-491bdbdf96a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:51.840553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9c282-1be1-4b53-9b5e-491bdbdf96a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:51.841078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9c282-1be1-4b53-9b5e-491bdbdf96a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:51.841540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9c282-1be1-4b53-9b5e-491bdbdf96a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:51.843904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0ec9c282-1be1-4b53-9b5e-491bdbdf96a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:51.874022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 877/1777] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:51.878776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1526-3bb8-4ada-9451-fe6960b7b92f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:51.910172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:51.942451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e1526-3bb8-4ada-9451-fe6960b7b92f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:51.980665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5d635-c527-47d4-964a-c1729d77327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:51.984966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5d635-c527-47d4-964a-c1729d77327c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:51.988219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5d635-c527-47d4-964a-c1729d77327c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:51.989914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5d635-c527-47d4-964a-c1729d77327c admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:51.991033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5d635-c527-47d4-964a-c1729d77327c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:51.995076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5d635-c527-47d4-964a-c1729d77327c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:52.032403 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9c282-1be1-4b53-9b5e-491bdbdf96a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:52.034672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9c282-1be1-4b53-9b5e-491bdbdf96a7 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:52.060054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 878/1778] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:52.060054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5d635-c527-47d4-964a-c1729d77327c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:52.068672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 901/1779] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:52.070044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9c282-1be1-4b53-9b5e-491bdbdf96a7 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:52.101804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9c282-1be1-4b53-9b5e-491bdbdf96a7 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:52.112574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934c49d-b95d-4438-9fe1-8dfb4dea6dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:52.113566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934c49d-b95d-4438-9fe1-8dfb4dea6dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:52.113848 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934c49d-b95d-4438-9fe1-8dfb4dea6dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:52.114115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934c49d-b95d-4438-9fe1-8dfb4dea6dfc admin admin] PATH_INFO: `/v3/projects/3a2dc19119ff437e995c084c39a1cb7e/users/f9cb11f674354e55aa8dc46d22c5bf67/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:52.119122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5d635-c527-47d4-964a-c1729d77327c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:52.148865 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87f69f-2e07-48e8-945c-4de11f3f01af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:52.149837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87f69f-2e07-48e8-945c-4de11f3f01af service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:52.149837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87f69f-2e07-48e8-945c-4de11f3f01af service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:52.150089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87f69f-2e07-48e8-945c-4de11f3f01af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:52.155625 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8c87f69f-2e07-48e8-945c-4de11f3f01af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:52.155819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934c49d-b95d-4438-9fe1-8dfb4dea6dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2dc19119ff437e995c084c39a1cb7e, user_id=f9cb11f674354e55aa8dc46d22c5bf67, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:52.160732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934c49d-b95d-4438-9fe1-8dfb4dea6dfc admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:52.196994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 902/1780] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:52 2022] PUT /identity/v3/projects/3a2dc19119ff437e995c084c39a1cb7e/users/f9cb11f674354e55aa8dc46d22c5bf67/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:52.210430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db745b-de06-4340-bc04-c17e435bd518 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:52.211702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db745b-de06-4340-bc04-c17e435bd518 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:52.212692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db745b-de06-4340-bc04-c17e435bd518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:52.318767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-66db745b-de06-4340-bc04-c17e435bd518 None None] MFA Rules not processed for user `f9cb11f674354e55aa8dc46d22c5bf67`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:52.329110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-66db745b-de06-4340-bc04-c17e435bd518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:52.365536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:52.426007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87f69f-2e07-48e8-945c-4de11f3f01af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:52.427628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87f69f-2e07-48e8-945c-4de11f3f01af service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:52.488601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 879/1781] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:52.571701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 903/1782] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:52.576791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87f69f-2e07-48e8-945c-4de11f3f01af service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:52.601455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87f69f-2e07-48e8-945c-4de11f3f01af service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:52.919748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1fc2f-a163-4f6d-81da-d5dfea5dc05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:52.922015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1fc2f-a163-4f6d-81da-d5dfea5dc05b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:52.922015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1fc2f-a163-4f6d-81da-d5dfea5dc05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:52.922015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1fc2f-a163-4f6d-81da-d5dfea5dc05b admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:52.922015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1fc2f-a163-4f6d-81da-d5dfea5dc05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:52.944323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde1fc2f-a163-4f6d-81da-d5dfea5dc05b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:53.215463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 880/1783] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:30:52 2022] POST /identity/v3/projects => generated 383 bytes in 639 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:30:53.232322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db745b-de06-4340-bc04-c17e435bd518 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:53.264463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db745b-de06-4340-bc04-c17e435bd518 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:53.697133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146f8e-f3bf-4996-8936-fa71d05a5fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:53.697848 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146f8e-f3bf-4996-8936-fa71d05a5fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:53.698132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146f8e-f3bf-4996-8936-fa71d05a5fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:53.698408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146f8e-f3bf-4996-8936-fa71d05a5fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:53.702497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f146f8e-f3bf-4996-8936-fa71d05a5fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:53.704589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f146f8e-f3bf-4996-8936-fa71d05a5fb7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:53.765830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 904/1784] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:30:53 2022] POST /identity/v3/users => generated 298 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:30:53.767797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1fc2f-a163-4f6d-81da-d5dfea5dc05b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:53.803042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1fc2f-a163-4f6d-81da-d5dfea5dc05b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:53.833451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec668853-1ff7-4743-ac3b-5f963bfda5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:53.834158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668853-1ff7-4743-ac3b-5f963bfda5ee admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:53.834441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668853-1ff7-4743-ac3b-5f963bfda5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:53.834715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668853-1ff7-4743-ac3b-5f963bfda5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:53.835461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec668853-1ff7-4743-ac3b-5f963bfda5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:53.845997 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec668853-1ff7-4743-ac3b-5f963bfda5ee admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:53.886390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 881/1785] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:53.888830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146f8e-f3bf-4996-8936-fa71d05a5fb7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:53.899794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146f8e-f3bf-4996-8936-fa71d05a5fb7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:53.949219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd717a-bdad-4daa-bcb8-1ef81bcf86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:53.953714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd717a-bdad-4daa-bcb8-1ef81bcf86a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:53.954217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd717a-bdad-4daa-bcb8-1ef81bcf86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:53.954649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd717a-bdad-4daa-bcb8-1ef81bcf86a5 admin admin] PATH_INFO: `/v3/projects/e7d22de7823147e7a697ebad0be8f2a1/users/4c78ef24d2984763a7a9fa25ca49c11c/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:53.978987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:54.002451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd717a-bdad-4daa-bcb8-1ef81bcf86a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d22de7823147e7a697ebad0be8f2a1, user_id=4c78ef24d2984763a7a9fa25ca49c11c, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:54.023589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd717a-bdad-4daa-bcb8-1ef81bcf86a5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:54.098973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 905/1786] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:53 2022] PUT /identity/v3/projects/e7d22de7823147e7a697ebad0be8f2a1/users/4c78ef24d2984763a7a9fa25ca49c11c/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:54.102907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec668853-1ff7-4743-ac3b-5f963bfda5ee admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:54.126665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec668853-1ff7-4743-ac3b-5f963bfda5ee admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:54.275636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a48d6-1ceb-45fe-a80b-3a9a5945c9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:54.276353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a48d6-1ceb-45fe-a80b-3a9a5945c9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:54.276681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a48d6-1ceb-45fe-a80b-3a9a5945c9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:54.276956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a48d6-1ceb-45fe-a80b-3a9a5945c9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:54.277988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a48d6-1ceb-45fe-a80b-3a9a5945c9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:54.279674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a48d6-1ceb-45fe-a80b-3a9a5945c9f4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:54.294658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9afd4-f203-44c0-8f25-087232c2db4e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:54.295010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9afd4-f203-44c0-8f25-087232c2db4e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:54.295289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9afd4-f203-44c0-8f25-087232c2db4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:54.320206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 882/1787] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:30:54 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:30:54.322633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a48d6-1ceb-45fe-a80b-3a9a5945c9f4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:54.333362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e3e9afd4-f203-44c0-8f25-087232c2db4e None None] MFA Rules not processed for user `94e69d561087490eb018178c3af5bc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:54.334635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e3e9afd4-f203-44c0-8f25-087232c2db4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:54.341905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a48d6-1ceb-45fe-a80b-3a9a5945c9f4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:54.395654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca11cc-40e3-45f1-b71a-373540a9a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:54.415533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca11cc-40e3-45f1-b71a-373540a9a0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:54.417194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca11cc-40e3-45f1-b71a-373540a9a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:54.417194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca11cc-40e3-45f1-b71a-373540a9a0ef admin admin] PATH_INFO: `/v3/projects/e7d22de7823147e7a697ebad0be8f2a1/users/4c78ef24d2984763a7a9fa25ca49c11c/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:54.423507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca11cc-40e3-45f1-b71a-373540a9a0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d22de7823147e7a697ebad0be8f2a1, user_id=4c78ef24d2984763a7a9fa25ca49c11c, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:54.426373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca11cc-40e3-45f1-b71a-373540a9a0ef admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:54.466260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 883/1788] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:30:54 2022] PUT /identity/v3/projects/e7d22de7823147e7a697ebad0be8f2a1/users/4c78ef24d2984763a7a9fa25ca49c11c/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:54.471441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077f57e-dcd3-4273-b3ae-d6987cbb74dc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:54.473586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077f57e-dcd3-4273-b3ae-d6987cbb74dc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:54.474113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077f57e-dcd3-4273-b3ae-d6987cbb74dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:54.536342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2077f57e-dcd3-4273-b3ae-d6987cbb74dc None None] MFA Rules not processed for user `5d773059c4b34e3e9c19e8355093266f`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:54.541850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2077f57e-dcd3-4273-b3ae-d6987cbb74dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:54.625568 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 906/1789] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:54.627106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e20a7-8d53-4314-9865-db0e23f5a1c0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:54.627389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e20a7-8d53-4314-9865-db0e23f5a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:54.627662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e20a7-8d53-4314-9865-db0e23f5a1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:54.719511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:54.739447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0a9e20a7-8d53-4314-9865-db0e23f5a1c0 None None] MFA Rules not processed for user `4c78ef24d2984763a7a9fa25ca49c11c`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:54.740685 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0a9e20a7-8d53-4314-9865-db0e23f5a1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:54.790455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 884/1790] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:55.061883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3edff0-28ab-4488-8188-2b47c131e504 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:55.062364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3edff0-28ab-4488-8188-2b47c131e504 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:55.062744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3edff0-28ab-4488-8188-2b47c131e504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:55.116880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fe3edff0-28ab-4488-8188-2b47c131e504 None None] MFA Rules not processed for user `11785acde2f74ad481d1224f2a7fd296`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:55.121732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 907/1791] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:55.123438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fe3edff0-28ab-4488-8188-2b47c131e504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:55.542044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 885/1792] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jul 1 16:30:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:30:55.593814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e20a7-8d53-4314-9865-db0e23f5a1c0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:55.617191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e20a7-8d53-4314-9865-db0e23f5a1c0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:55.641092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cfa20-949e-46b3-b89f-8294994b1884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:55.662643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cfa20-949e-46b3-b89f-8294994b1884 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:55.663337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cfa20-949e-46b3-b89f-8294994b1884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:55.665582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cfa20-949e-46b3-b89f-8294994b1884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:55.698838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cfa20-949e-46b3-b89f-8294994b1884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:55.701449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cfa20-949e-46b3-b89f-8294994b1884 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:55.754419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 908/1793] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:55.755084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3edff0-28ab-4488-8188-2b47c131e504 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:56.020040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3edff0-28ab-4488-8188-2b47c131e504 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:56.040895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c204d6-34f1-4a04-9729-228db9e8cf89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:56.044491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c204d6-34f1-4a04-9729-228db9e8cf89 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:56.044821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c204d6-34f1-4a04-9729-228db9e8cf89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:56.045157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c204d6-34f1-4a04-9729-228db9e8cf89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:56.105886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c204d6-34f1-4a04-9729-228db9e8cf89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:56.111156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c204d6-34f1-4a04-9729-228db9e8cf89 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:56.159624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 886/1794] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:56.346936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cfa20-949e-46b3-b89f-8294994b1884 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:56.348753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-853cfa20-949e-46b3-b89f-8294994b1884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:56.504114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c204d6-34f1-4a04-9729-228db9e8cf89 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:56.517408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c204d6-34f1-4a04-9729-228db9e8cf89 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:56.523815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ab06f-dd5f-4607-bf07-81458968f09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:56.524839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ab06f-dd5f-4607-bf07-81458968f09f service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:56.525341 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ab06f-dd5f-4607-bf07-81458968f09f service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:56.525805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ab06f-dd5f-4607-bf07-81458968f09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:56.662724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cfa20-949e-46b3-b89f-8294994b1884 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:56.675753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:56.678192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:56.678710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:56.679167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] PATH_INFO: `/v3/projects/fa168568cde4430a80a795cdcf8c8ff2` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:56.686533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa168568cde4430a80a795cdcf8c8ff2)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:56.697671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:56.730635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:56.803881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ab06f-dd5f-4607-bf07-81458968f09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:56.808352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ab06f-dd5f-4607-bf07-81458968f09f service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:56.873245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 887/1795] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:30:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:30:56.874666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa168568cde4430a80a795cdcf8c8ff2', 'request_id': 'req-784f9023-832d-4ba3-8487-a19c797fcfb0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:56.891407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa168568cde4430a80a795cdcf8c8ff2', 'request_id': 'req-784f9023-832d-4ba3-8487-a19c797fcfb0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:56.912002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa168568cde4430a80a795cdcf8c8ff2', 'request_id': 'req-784f9023-832d-4ba3-8487-a19c797fcfb0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:56.941436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] The token cache is being invalidate because project fa168568cde4430a80a795cdcf8c8ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:30:56.942074 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:56.943344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:56.957972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 909/1796] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:30:56 2022] DELETE /identity/v3/projects/fa168568cde4430a80a795cdcf8c8ff2 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:56.959151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ab06f-dd5f-4607-bf07-81458968f09f service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:56.989771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ab06f-dd5f-4607-bf07-81458968f09f service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:57.126118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:30:57.182375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:57.185069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:57.185069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:57.185069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] PATH_INFO: `/v3/users/600805e7799646e49b85ae1d446871fb` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:57.193817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600805e7799646e49b85ae1d446871fb)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:57.196026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:57.347382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600805e7799646e49b85ae1d446871fb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:57.349815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600805e7799646e49b85ae1d446871fb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:57.351260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600805e7799646e49b85ae1d446871fb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:57.426408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600805e7799646e49b85ae1d446871fb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:57.460492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2e95a886-04b6-4b08-9a67-42f7525e73f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600805e7799646e49b85ae1d446871fb'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:57.517874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 888/1797] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:56 2022] DELETE /identity/v3/users/600805e7799646e49b85ae1d446871fb => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:59.104193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:30:59.106882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:59.165293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f9023-832d-4ba3-8487-a19c797fcfb0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:30:59.301125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:30:59.303019 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:59.305260 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:59.305897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] PATH_INFO: `/v3/users/951750b2d18443019271b2b2bf8ad9ba` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:59.310380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=951750b2d18443019271b2b2bf8ad9ba)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:30:59.318924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:30:59.509430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951750b2d18443019271b2b2bf8ad9ba'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:59.512727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951750b2d18443019271b2b2bf8ad9ba'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:59.514436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe10d-7e10-4ccf-8d6b-662f78b5886c None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:59.515059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe10d-7e10-4ccf-8d6b-662f78b5886c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:59.515059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe10d-7e10-4ccf-8d6b-662f78b5886c None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:59.516610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 889/1798] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:30:59.531477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951750b2d18443019271b2b2bf8ad9ba'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:59.567113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951750b2d18443019271b2b2bf8ad9ba'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:59.569811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a8fb9a44-1f8f-47e2-a012-01984f91a52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951750b2d18443019271b2b2bf8ad9ba'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:30:59.599782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58c81-3221-4826-9ebd-1db5f8c5f9db None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:59.600441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58c81-3221-4826-9ebd-1db5f8c5f9db None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:59.600892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58c81-3221-4826-9ebd-1db5f8c5f9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:59.658712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8dc58c81-3221-4826-9ebd-1db5f8c5f9db None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:59.680977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8dc58c81-3221-4826-9ebd-1db5f8c5f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:59.693573 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 910/1799] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:30:59 2022] DELETE /identity/v3/users/951750b2d18443019271b2b2bf8ad9ba => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:30:59.695177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c28d57-52a4-4a0d-bc43-cee912da744f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:30:59.695473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c28d57-52a4-4a0d-bc43-cee912da744f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:30:59.695753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c28d57-52a4-4a0d-bc43-cee912da744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:30:59.795696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a8c28d57-52a4-4a0d-bc43-cee912da744f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:30:59.797054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a8c28d57-52a4-4a0d-bc43-cee912da744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:30:59.847340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:00.041493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 890/1800] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:30:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:00.094982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 911/1801] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:00.658491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58c81-3221-4826-9ebd-1db5f8c5f9db None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:00.660004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8dc58c81-3221-4826-9ebd-1db5f8c5f9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:00.679823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c28d57-52a4-4a0d-bc43-cee912da744f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:00.683164 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a8c28d57-52a4-4a0d-bc43-cee912da744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:00.690796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58c81-3221-4826-9ebd-1db5f8c5f9db None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:00.711501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f2021-3854-498e-a9d6-3f30b158fc04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:00.712647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f2021-3854-498e-a9d6-3f30b158fc04 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:00.712647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f2021-3854-498e-a9d6-3f30b158fc04 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:00.712954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f2021-3854-498e-a9d6-3f30b158fc04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:00.722044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c28d57-52a4-4a0d-bc43-cee912da744f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:00.732968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f2021-3854-498e-a9d6-3f30b158fc04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:00.736115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f2021-3854-498e-a9d6-3f30b158fc04 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:00.746109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:00.758112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:00.759694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:00.764350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] PATH_INFO: `/v3/users/f9cb11f674354e55aa8dc46d22c5bf67` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:00.770755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9cb11f674354e55aa8dc46d22c5bf67)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:00.774755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 891/1802] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:00.779401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:00.927662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9cb11f674354e55aa8dc46d22c5bf67'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:00.928454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9cb11f674354e55aa8dc46d22c5bf67'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:00.980886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9cb11f674354e55aa8dc46d22c5bf67'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:00.993467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9cb11f674354e55aa8dc46d22c5bf67'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:00.994590 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6be7163a-dfc8-4941-8160-627c06020199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9cb11f674354e55aa8dc46d22c5bf67'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:01.020901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 912/1803] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:00 2022] DELETE /identity/v3/users/f9cb11f674354e55aa8dc46d22c5bf67 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:01.022647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ebb0b-718a-40c4-ab30-881a780b5457 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:01.022938 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ebb0b-718a-40c4-ab30-881a780b5457 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:01.023212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ebb0b-718a-40c4-ab30-881a780b5457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:01.056684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0e9ebb0b-718a-40c4-ab30-881a780b5457 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:01.058561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0e9ebb0b-718a-40c4-ab30-881a780b5457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:01.092448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60244-4708-42ed-b725-0797e549fa19 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:01.092814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60244-4708-42ed-b725-0797e549fa19 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:01.093132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b60244-4708-42ed-b725-0797e549fa19 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:01.094886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 913/1804] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:31:01.097689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60244-4708-42ed-b725-0797e549fa19 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:01.099370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-68b60244-4708-42ed-b725-0797e549fa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:01.139852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:01.221891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b60244-4708-42ed-b725-0797e549fa19 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:01.229792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 892/1805] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:01.231154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b4e11-add6-43da-85e4-c246d16f37ec None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:01.231440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b4e11-add6-43da-85e4-c246d16f37ec None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:01.232013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b4e11-add6-43da-85e4-c246d16f37ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:01.261838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:01.262899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:01.262899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:01.263253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:01.275949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:01.290156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-251b4e11-add6-43da-85e4-c246d16f37ec None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:01.291413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-251b4e11-add6-43da-85e4-c246d16f37ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:01.313936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:01.321271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:01.350085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 914/1806] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:31:01.350337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:01.353571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:01.382355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbebc9-2b08-49d3-bf4b-e43ac0592d41 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:01.394658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521398-6c8b-4666-b3b9-69567d8bb110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:01.395494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521398-6c8b-4666-b3b9-69567d8bb110 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:01.395878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521398-6c8b-4666-b3b9-69567d8bb110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:01.396252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca521398-6c8b-4666-b3b9-69567d8bb110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:01.438707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca521398-6c8b-4666-b3b9-69567d8bb110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:01.442482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca521398-6c8b-4666-b3b9-69567d8bb110 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:01.481857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 915/1807] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:01.497406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 893/1808] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:31:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:01.708186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521398-6c8b-4666-b3b9-69567d8bb110 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:01.713273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ca521398-6c8b-4666-b3b9-69567d8bb110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:01.755173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca521398-6c8b-4666-b3b9-69567d8bb110 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:01.771871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:01.783867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:01.784216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:01.784544 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] PATH_INFO: `/v3/projects/179e7ff30f0b4ba49a4a5ebd20016742` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:01.786811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=179e7ff30f0b4ba49a4a5ebd20016742)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:01.791772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:01.799254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b4e11-add6-43da-85e4-c246d16f37ec None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:01.801674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-251b4e11-add6-43da-85e4-c246d16f37ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:01.838530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b4e11-add6-43da-85e4-c246d16f37ec None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:01.854200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:01.871017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95251a80-fb7a-4d2d-96c7-80af93259a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:01.874024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251a80-fb7a-4d2d-96c7-80af93259a5b service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:01.874378 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251a80-fb7a-4d2d-96c7-80af93259a5b service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:01.874708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251a80-fb7a-4d2d-96c7-80af93259a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:01.909467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95251a80-fb7a-4d2d-96c7-80af93259a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:01.911910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95251a80-fb7a-4d2d-96c7-80af93259a5b service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:01.939755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 894/1809] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:01.948083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '179e7ff30f0b4ba49a4a5ebd20016742', 'request_id': 'req-c7cafd70-e52e-442a-bede-b4bc9601d4e1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:01.955666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '179e7ff30f0b4ba49a4a5ebd20016742', 'request_id': 'req-c7cafd70-e52e-442a-bede-b4bc9601d4e1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:01.998585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '179e7ff30f0b4ba49a4a5ebd20016742', 'request_id': 'req-c7cafd70-e52e-442a-bede-b4bc9601d4e1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:02.029277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] The token cache is being invalidate because project 179e7ff30f0b4ba49a4a5ebd20016742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:02.030453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:02.031852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c7cafd70-e52e-442a-bede-b4bc9601d4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:02.038823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 916/1810] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:01 2022] DELETE /identity/v3/projects/179e7ff30f0b4ba49a4a5ebd20016742 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:02.046677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99ddf9-370d-4165-a306-fc66fb215565 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:02.047001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99ddf9-370d-4165-a306-fc66fb215565 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:02.047506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99ddf9-370d-4165-a306-fc66fb215565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:02.110630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-be99ddf9-370d-4165-a306-fc66fb215565 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:02.130348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-be99ddf9-370d-4165-a306-fc66fb215565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:02.323040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 895/1811] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:02.331989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4ff12-5d53-42de-a7fe-19c8fae78c48 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:02.332296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4ff12-5d53-42de-a7fe-19c8fae78c48 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:02.332578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4ff12-5d53-42de-a7fe-19c8fae78c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:02.386017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e4e4ff12-5d53-42de-a7fe-19c8fae78c48 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:02.396684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e4e4ff12-5d53-42de-a7fe-19c8fae78c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:02.430587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 917/1812] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:02.434582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99ddf9-370d-4165-a306-fc66fb215565 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:02.454424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99ddf9-370d-4165-a306-fc66fb215565 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:02.493463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd340438-4036-423d-8803-a1b81216cbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:02.494173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd340438-4036-423d-8803-a1b81216cbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:02.494457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd340438-4036-423d-8803-a1b81216cbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:02.494730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd340438-4036-423d-8803-a1b81216cbb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:02.495533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd340438-4036-423d-8803-a1b81216cbb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:02.495838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd340438-4036-423d-8803-a1b81216cbb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:02.502169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd340438-4036-423d-8803-a1b81216cbb0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:02.581931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 896/1813] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:02.586874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4ff12-5d53-42de-a7fe-19c8fae78c48 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:02.597855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4ff12-5d53-42de-a7fe-19c8fae78c48 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:02.633741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452932e1-8790-4a38-ab72-cc7cc8c870f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:02.634552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452932e1-8790-4a38-ab72-cc7cc8c870f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:02.634835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452932e1-8790-4a38-ab72-cc7cc8c870f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:02.635112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452932e1-8790-4a38-ab72-cc7cc8c870f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:02.640258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452932e1-8790-4a38-ab72-cc7cc8c870f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:02.642295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452932e1-8790-4a38-ab72-cc7cc8c870f7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:02.724217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 918/1814] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:02 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:02.728194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd340438-4036-423d-8803-a1b81216cbb0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:02.741109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd340438-4036-423d-8803-a1b81216cbb0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:02.874707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:02.910496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e41ea7-f338-4b11-99ff-245dbc56042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:02.910496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41ea7-f338-4b11-99ff-245dbc56042c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:02.910496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41ea7-f338-4b11-99ff-245dbc56042c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:02.911259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41ea7-f338-4b11-99ff-245dbc56042c admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:02.912112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41ea7-f338-4b11-99ff-245dbc56042c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:02.914397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41ea7-f338-4b11-99ff-245dbc56042c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:02.968288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 897/1815] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:02 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:02.972664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452932e1-8790-4a38-ab72-cc7cc8c870f7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:02.991761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452932e1-8790-4a38-ab72-cc7cc8c870f7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:03.015847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e1e39-3247-4585-b424-faf705a6fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:03.016643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e1e39-3247-4585-b424-faf705a6fcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:03.017036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e1e39-3247-4585-b424-faf705a6fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:03.017383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e1e39-3247-4585-b424-faf705a6fcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:03.018198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e1e39-3247-4585-b424-faf705a6fcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:03.019979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e1e39-3247-4585-b424-faf705a6fcc6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:03.075083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 919/1816] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:03.078365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e41ea7-f338-4b11-99ff-245dbc56042c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:03.097848 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e41ea7-f338-4b11-99ff-245dbc56042c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:03.118399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565af29a-4275-4d13-a411-6011b4c53253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:03.119631 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565af29a-4275-4d13-a411-6011b4c53253 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:03.120063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565af29a-4275-4d13-a411-6011b4c53253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:03.121346 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565af29a-4275-4d13-a411-6011b4c53253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:03.122269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565af29a-4275-4d13-a411-6011b4c53253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:03.124435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565af29a-4275-4d13-a411-6011b4c53253 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:03.154787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 898/1817] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:03.158901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e1e39-3247-4585-b424-faf705a6fcc6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:03.183321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e1e39-3247-4585-b424-faf705a6fcc6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:03.217506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a1f69-9dde-4ddf-8872-68aea8a133df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:03.218557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a1f69-9dde-4ddf-8872-68aea8a133df admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:03.218852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a1f69-9dde-4ddf-8872-68aea8a133df admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:03.219193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a1f69-9dde-4ddf-8872-68aea8a133df admin admin] PATH_INFO: `/v3/projects/e5f1b6f9a3304bd9a6fea6c2aa717689/users/f2461084b85c473c86d9dac824d831c0/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:03.259454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a1f69-9dde-4ddf-8872-68aea8a133df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5f1b6f9a3304bd9a6fea6c2aa717689, user_id=f2461084b85c473c86d9dac824d831c0, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:03.263085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a1f69-9dde-4ddf-8872-68aea8a133df admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:03.291442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 920/1818] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:03 2022] PUT /identity/v3/projects/e5f1b6f9a3304bd9a6fea6c2aa717689/users/f2461084b85c473c86d9dac824d831c0/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:03.303630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a4a3-22f1-4c1a-89e9-66229682601e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:03.303952 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a4a3-22f1-4c1a-89e9-66229682601e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:03.304232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358a4a3-22f1-4c1a-89e9-66229682601e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:03.361219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d358a4a3-22f1-4c1a-89e9-66229682601e None None] MFA Rules not processed for user `f2461084b85c473c86d9dac824d831c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:03.363276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d358a4a3-22f1-4c1a-89e9-66229682601e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:03.479012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 899/1819] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:03.483784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a1f69-9dde-4ddf-8872-68aea8a133df admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:03.641703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a1f69-9dde-4ddf-8872-68aea8a133df admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:03.661849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec19685-d97e-446c-a601-3be66af88c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:03.664241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec19685-d97e-446c-a601-3be66af88c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:03.664543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec19685-d97e-446c-a601-3be66af88c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:03.664822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec19685-d97e-446c-a601-3be66af88c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:03.666492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec19685-d97e-446c-a601-3be66af88c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:03.668441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec19685-d97e-446c-a601-3be66af88c6d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:03.778282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 921/1820] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:03 2022] POST /identity/v3/projects => generated 377 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:03.779918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a4a3-22f1-4c1a-89e9-66229682601e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:03.784806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec19685-d97e-446c-a601-3be66af88c6d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:03.789705 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fec19685-d97e-446c-a601-3be66af88c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:03.809415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358a4a3-22f1-4c1a-89e9-66229682601e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:03.863812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:03.963235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec19685-d97e-446c-a601-3be66af88c6d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:03.976894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:03.977797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:03.978083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:03.978405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] PATH_INFO: `/v3/projects/3a2dc19119ff437e995c084c39a1cb7e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:03.981658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2dc19119ff437e995c084c39a1cb7e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:03.984900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:03.993090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585cb54-9bd4-463a-8c9f-5342f9f5c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:03.994536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585cb54-9bd4-463a-8c9f-5342f9f5c576 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:03.995030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585cb54-9bd4-463a-8c9f-5342f9f5c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:03.995501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585cb54-9bd4-463a-8c9f-5342f9f5c576 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:03.996407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585cb54-9bd4-463a-8c9f-5342f9f5c576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:03.998656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8585cb54-9bd4-463a-8c9f-5342f9f5c576 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:04.036076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 900/1821] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:03 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:04.037633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585cb54-9bd4-463a-8c9f-5342f9f5c576 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:04.039960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8585cb54-9bd4-463a-8c9f-5342f9f5c576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:04.058329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585cb54-9bd4-463a-8c9f-5342f9f5c576 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:04.066577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:04.070176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:04.071360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:04.072163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] PATH_INFO: `/v3/projects/7081e080e9b04f788d50a8d6490afd3c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:04.096943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7081e080e9b04f788d50a8d6490afd3c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:04.096943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:04.127692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2dc19119ff437e995c084c39a1cb7e', 'request_id': 'req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.134121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2dc19119ff437e995c084c39a1cb7e', 'request_id': 'req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.146369 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2dc19119ff437e995c084c39a1cb7e', 'request_id': 'req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.164893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] The token cache is being invalidate because project 3a2dc19119ff437e995c084c39a1cb7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:04.165346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.166083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.173461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:04.174853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 922/1822] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:03 2022] DELETE /identity/v3/projects/3a2dc19119ff437e995c084c39a1cb7e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:04.177008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:04.179422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:04.193003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7081e080e9b04f788d50a8d6490afd3c', 'request_id': 'req-7653d12a-5821-437a-9896-e2f8951b810d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.206270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7081e080e9b04f788d50a8d6490afd3c', 'request_id': 'req-7653d12a-5821-437a-9896-e2f8951b810d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.224909 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7081e080e9b04f788d50a8d6490afd3c', 'request_id': 'req-7653d12a-5821-437a-9896-e2f8951b810d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.249282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] The token cache is being invalidate because project 7081e080e9b04f788d50a8d6490afd3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:04.249924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.250879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.253574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 901/1823] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:04 2022] DELETE /identity/v3/projects/7081e080e9b04f788d50a8d6490afd3c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:04.255003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:04.257019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:04.286273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6f326-3c89-45d1-ba6b-3033f0f10d66 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:04.374720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7eb7-42c8-47fe-a27e-61c73186da19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:04.375551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7eb7-42c8-47fe-a27e-61c73186da19 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:04.375838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7eb7-42c8-47fe-a27e-61c73186da19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:04.376124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7eb7-42c8-47fe-a27e-61c73186da19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:04.376902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7eb7-42c8-47fe-a27e-61c73186da19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:04.378593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7eb7-42c8-47fe-a27e-61c73186da19 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:04.380342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:04.391958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 923/1824] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:04.392924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7eb7-42c8-47fe-a27e-61c73186da19 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:04.395851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fd1a7eb7-42c8-47fe-a27e-61c73186da19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:04.415148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7eb7-42c8-47fe-a27e-61c73186da19 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:04.422621 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:04.423790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:04.424189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:04.424563 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] PATH_INFO: `/v3/users/4c78ef24d2984763a7a9fa25ca49c11c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:04.430580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c78ef24d2984763a7a9fa25ca49c11c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:04.432756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:04.507249 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c78ef24d2984763a7a9fa25ca49c11c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.507933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c78ef24d2984763a7a9fa25ca49c11c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.521238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653d12a-5821-437a-9896-e2f8951b810d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:04.521478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c78ef24d2984763a7a9fa25ca49c11c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.531073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:04.532575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:04.533186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:04.533613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] PATH_INFO: `/v3/users/e8ba5aab06174901b7647ccbef537421` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:04.534470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c78ef24d2984763a7a9fa25ca49c11c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.535305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c78ef24d2984763a7a9fa25ca49c11c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.535880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ba5aab06174901b7647ccbef537421)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:04.538829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:04.566799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 924/1825] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:04 2022] DELETE /identity/v3/users/4c78ef24d2984763a7a9fa25ca49c11c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:04.570809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:04.570809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:04.637578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ba5aab06174901b7647ccbef537421'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.641849 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ba5aab06174901b7647ccbef537421'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.642609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ba5aab06174901b7647ccbef537421'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.660527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ba5aab06174901b7647ccbef537421'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.679672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ba5aab06174901b7647ccbef537421'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.707387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c3e60-c784-47a0-9473-f78787007da4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:04.713960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 902/1826] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:04 2022] DELETE /identity/v3/users/e8ba5aab06174901b7647ccbef537421 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:04.714958 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:04.724336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:04.727432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:04.728448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:04.729587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:04.729882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] PATH_INFO: `/v3/users/c4e3242fd02942fd8b007c5a67c64478` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:04.749613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e3242fd02942fd8b007c5a67c64478)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:04.753576 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:04.849414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:04.882829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e3242fd02942fd8b007c5a67c64478'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.883750 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e3242fd02942fd8b007c5a67c64478'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.907037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e3242fd02942fd8b007c5a67c64478'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.907382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d65a11-dcdc-4d89-9ecb-916c15b896e2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:04.914616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be31ebf-95c8-4440-b609-271886e94c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:04.915696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be31ebf-95c8-4440-b609-271886e94c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:04.915975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be31ebf-95c8-4440-b609-271886e94c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:04.916410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be31ebf-95c8-4440-b609-271886e94c14 admin admin] PATH_INFO: `/v3/projects/83b733433cc4475087331c49fc2850b0/users/baf34d15157b4d958e1a87010e6dc438/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:04.917107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e3242fd02942fd8b007c5a67c64478'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.918448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-50a24184-b18c-4be1-a066-9bf1eb4a0679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e3242fd02942fd8b007c5a67c64478'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:04.928629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:04.944107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be31ebf-95c8-4440-b609-271886e94c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b733433cc4475087331c49fc2850b0, user_id=baf34d15157b4d958e1a87010e6dc438, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:04.948318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be31ebf-95c8-4440-b609-271886e94c14 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:04.968366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 925/1827] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:04 2022] DELETE /identity/v3/users/c4e3242fd02942fd8b007c5a67c64478 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:04.970735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6652-3ff6-44d4-b9f8-619e812451a8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:04.971125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6652-3ff6-44d4-b9f8-619e812451a8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:04.971428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6652-3ff6-44d4-b9f8-619e812451a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:04.985279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 903/1828] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:04 2022] PUT /identity/v3/projects/83b733433cc4475087331c49fc2850b0/users/baf34d15157b4d958e1a87010e6dc438/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:04.988864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be31ebf-95c8-4440-b609-271886e94c14 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:04.991174 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7be31ebf-95c8-4440-b609-271886e94c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:04.993748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-33aa6652-3ff6-44d4-b9f8-619e812451a8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:04.995124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-33aa6652-3ff6-44d4-b9f8-619e812451a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.085869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 926/1829] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:05.103721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be31ebf-95c8-4440-b609-271886e94c14 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:05.104317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa6652-3ff6-44d4-b9f8-619e812451a8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.105689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-33aa6652-3ff6-44d4-b9f8-619e812451a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.113449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57f9b4-7333-4421-ba81-179ac1cb6172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:05.116133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57f9b4-7333-4421-ba81-179ac1cb6172 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.116635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57f9b4-7333-4421-ba81-179ac1cb6172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.117094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb57f9b4-7333-4421-ba81-179ac1cb6172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.118886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57f9b4-7333-4421-ba81-179ac1cb6172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:05.124229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb57f9b4-7333-4421-ba81-179ac1cb6172 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:05.139315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 904/1830] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:05.145325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57f9b4-7333-4421-ba81-179ac1cb6172 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.163101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb57f9b4-7333-4421-ba81-179ac1cb6172 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:05.169718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa8b47-0ea0-4a0f-aa02-b2524d37df90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:05.170976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa8b47-0ea0-4a0f-aa02-b2524d37df90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.171329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa8b47-0ea0-4a0f-aa02-b2524d37df90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.172453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa8b47-0ea0-4a0f-aa02-b2524d37df90 admin admin] PATH_INFO: `/v3/projects/83b733433cc4475087331c49fc2850b0/users/baf34d15157b4d958e1a87010e6dc438/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.175237 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa8b47-0ea0-4a0f-aa02-b2524d37df90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b733433cc4475087331c49fc2850b0, user_id=baf34d15157b4d958e1a87010e6dc438, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:05.179712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa8b47-0ea0-4a0f-aa02-b2524d37df90 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:05.191556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa6652-3ff6-44d4-b9f8-619e812451a8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:05.195942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd9257-9625-4b86-a975-dae78b9d9090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:05.196499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd9257-9625-4b86-a975-dae78b9d9090 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.196871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd9257-9625-4b86-a975-dae78b9d9090 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.197153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd9257-9625-4b86-a975-dae78b9d9090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.208397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd9257-9625-4b86-a975-dae78b9d9090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:05.210106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 905/1831] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:05 2022] PUT /identity/v3/projects/83b733433cc4475087331c49fc2850b0/users/baf34d15157b4d958e1a87010e6dc438/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:05.217063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd9257-9625-4b86-a975-dae78b9d9090 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:05.217573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa8b47-0ea0-4a0f-aa02-b2524d37df90 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.221053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-55fa8b47-0ea0-4a0f-aa02-b2524d37df90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.223557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 927/1832] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:31:05.224924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb165f-422f-47d5-88aa-c228584f8fab None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.225280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb165f-422f-47d5-88aa-c228584f8fab None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.225703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb165f-422f-47d5-88aa-c228584f8fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.265369 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-94cb165f-422f-47d5-88aa-c228584f8fab None None] MFA Rules not processed for user `baf34d15157b4d958e1a87010e6dc438`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:05.267524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-94cb165f-422f-47d5-88aa-c228584f8fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.320449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa8b47-0ea0-4a0f-aa02-b2524d37df90 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:05.329297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:05.330415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.330907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.331185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] PATH_INFO: `/v3/projects/e7d22de7823147e7a697ebad0be8f2a1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.332511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d22de7823147e7a697ebad0be8f2a1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:05.334707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:05.363147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 928/1833] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:05.370377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb165f-422f-47d5-88aa-c228584f8fab None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.372605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-94cb165f-422f-47d5-88aa-c228584f8fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.396595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb165f-422f-47d5-88aa-c228584f8fab None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:05.402972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:05.404124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.404383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.405314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] PATH_INFO: `/v3/projects/fb2541dcdada41049e7b832fa243d8a0` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.406214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2541dcdada41049e7b832fa243d8a0)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:05.408612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:05.422609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:05.427284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d22de7823147e7a697ebad0be8f2a1', 'request_id': 'req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.431170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:05.437157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d22de7823147e7a697ebad0be8f2a1', 'request_id': 'req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.448656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d22de7823147e7a697ebad0be8f2a1', 'request_id': 'req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.469530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] The token cache is being invalidate because project e7d22de7823147e7a697ebad0be8f2a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:05.469874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.471661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.478684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 906/1834] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:05 2022] DELETE /identity/v3/projects/e7d22de7823147e7a697ebad0be8f2a1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:05.479399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.480798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2541dcdada41049e7b832fa243d8a0', 'request_id': 'req-3a9c2d41-7017-47a8-a70d-a6307410af9c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.481060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.491416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2541dcdada41049e7b832fa243d8a0', 'request_id': 'req-3a9c2d41-7017-47a8-a70d-a6307410af9c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.507283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2541dcdada41049e7b832fa243d8a0', 'request_id': 'req-3a9c2d41-7017-47a8-a70d-a6307410af9c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.526895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] The token cache is being invalidate because project fb2541dcdada41049e7b832fa243d8a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:05.527344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.528988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3a9c2d41-7017-47a8-a70d-a6307410af9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:05.537670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 929/1835] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:05 2022] DELETE /identity/v3/projects/fb2541dcdada41049e7b832fa243d8a0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:05.537670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e476cd-f03b-4ca7-92cd-c675f5163057 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.537670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e476cd-f03b-4ca7-92cd-c675f5163057 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.537670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e476cd-f03b-4ca7-92cd-c675f5163057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.580463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-52e476cd-f03b-4ca7-92cd-c675f5163057 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:05.581673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-52e476cd-f03b-4ca7-92cd-c675f5163057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.609691 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747610a-5653-43c8-8ba3-f66a2cfb0d5f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:05.683440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3bc4-23fa-4e59-a49b-434fe8933540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:05.684379 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3bc4-23fa-4e59-a49b-434fe8933540 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.684753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3bc4-23fa-4e59-a49b-434fe8933540 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.685118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de3bc4-23fa-4e59-a49b-434fe8933540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.687671 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-37de3bc4-23fa-4e59-a49b-434fe8933540 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.694538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 930/1836] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:05.700499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a39670-b036-4e88-a760-3cc9e9604841 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.700707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a39670-b036-4e88-a760-3cc9e9604841 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.701015 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a39670-b036-4e88-a760-3cc9e9604841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.731547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-43a39670-b036-4e88-a760-3cc9e9604841 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:05.733277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-43a39670-b036-4e88-a760-3cc9e9604841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.751290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 931/1837] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:05.754775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9226d1-7d51-44e3-bdf9-771e5f75b619 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.756449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9226d1-7d51-44e3-bdf9-771e5f75b619 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.756778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9226d1-7d51-44e3-bdf9-771e5f75b619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.799399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bb9226d1-7d51-44e3-bdf9-771e5f75b619 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:05.800731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bb9226d1-7d51-44e3-bdf9-771e5f75b619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.809713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3bc4-23fa-4e59-a49b-434fe8933540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:05.811682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de3bc4-23fa-4e59-a49b-434fe8933540 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:05.815804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 932/1838] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:05.815804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb11bd-1e01-4a1b-af66-7f32ee0028e3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.815804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb11bd-1e01-4a1b-af66-7f32ee0028e3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.816349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb11bd-1e01-4a1b-af66-7f32ee0028e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.836504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 907/1839] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:05.837469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3bc4-23fa-4e59-a49b-434fe8933540 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.847491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d2eb11bd-1e01-4a1b-af66-7f32ee0028e3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:05.848932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d2eb11bd-1e01-4a1b-af66-7f32ee0028e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.850825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de3bc4-23fa-4e59-a49b-434fe8933540 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:05.856207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5cb0-100f-427b-bbb5-a071f73451f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:05.857153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5cb0-100f-427b-bbb5-a071f73451f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.857538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5cb0-100f-427b-bbb5-a071f73451f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.857925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5cb0-100f-427b-bbb5-a071f73451f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.858826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5cb0-100f-427b-bbb5-a071f73451f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:05.859242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5cb0-100f-427b-bbb5-a071f73451f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:05.859396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 933/1840] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:05.861414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac5cb0-100f-427b-bbb5-a071f73451f5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:05.865552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb11bd-1e01-4a1b-af66-7f32ee0028e3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.876655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb11bd-1e01-4a1b-af66-7f32ee0028e3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:05.879708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 908/1841] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:05.880810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5cb0-100f-427b-bbb5-a071f73451f5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.884192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada0d86-e86c-40d8-a655-34a5a750e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:05.885529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada0d86-e86c-40d8-a655-34a5a750e745 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.885812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada0d86-e86c-40d8-a655-34a5a750e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.886085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada0d86-e86c-40d8-a655-34a5a750e745 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.887106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada0d86-e86c-40d8-a655-34a5a750e745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:05.887415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada0d86-e86c-40d8-a655-34a5a750e745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:05.889601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada0d86-e86c-40d8-a655-34a5a750e745 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:05.892267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac5cb0-100f-427b-bbb5-a071f73451f5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:05.906267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd947f-22e5-4a1d-be07-7b91b9fa73e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:05.906916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd947f-22e5-4a1d-be07-7b91b9fa73e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:05.907480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd947f-22e5-4a1d-be07-7b91b9fa73e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:05.907807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd947f-22e5-4a1d-be07-7b91b9fa73e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:05.908631 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd947f-22e5-4a1d-be07-7b91b9fa73e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:05.914043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fd947f-22e5-4a1d-be07-7b91b9fa73e9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:05.932861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 934/1842] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:05.936306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada0d86-e86c-40d8-a655-34a5a750e745 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.959434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 909/1843] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:05 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:05.960371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd947f-22e5-4a1d-be07-7b91b9fa73e9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:05.968001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f9fd947f-22e5-4a1d-be07-7b91b9fa73e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:05.968498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada0d86-e86c-40d8-a655-34a5a750e745 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.005154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:06.113936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd947f-22e5-4a1d-be07-7b91b9fa73e9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.114572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd65998-f542-4c97-a418-f3d83af34904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.115098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd65998-f542-4c97-a418-f3d83af34904 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.115665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd65998-f542-4c97-a418-f3d83af34904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.116209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd65998-f542-4c97-a418-f3d83af34904 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.127582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.131991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd65998-f542-4c97-a418-f3d83af34904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.133099 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.133099 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.133322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] PATH_INFO: `/v3/projects/d71c4a83914946ad94dcdaa847c583fe` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.137126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71c4a83914946ad94dcdaa847c583fe)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.138467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd65998-f542-4c97-a418-f3d83af34904 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.142339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.164271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:06.202981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 935/1844] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:05 2022] POST /identity/v3/projects => generated 401 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:06.209122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd65998-f542-4c97-a418-f3d83af34904 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:06.290326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71c4a83914946ad94dcdaa847c583fe', 'request_id': 'req-99d6415b-ad41-4b28-a21f-9180c82126b5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.298585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71c4a83914946ad94dcdaa847c583fe', 'request_id': 'req-99d6415b-ad41-4b28-a21f-9180c82126b5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.317538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71c4a83914946ad94dcdaa847c583fe', 'request_id': 'req-99d6415b-ad41-4b28-a21f-9180c82126b5'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.344553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] The token cache is being invalidate because project d71c4a83914946ad94dcdaa847c583fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:06.345978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.347129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.349684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 910/1845] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:05 2022] DELETE /identity/v3/projects/d71c4a83914946ad94dcdaa847c583fe => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:06.351680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:06.353991 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:06.373117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd65998-f542-4c97-a418-f3d83af34904 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.478926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6415b-ad41-4b28-a21f-9180c82126b5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.484271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e768b-03e1-4e40-9ef1-c08794ccab27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.485161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e768b-03e1-4e40-9ef1-c08794ccab27 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.485463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e768b-03e1-4e40-9ef1-c08794ccab27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.485742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e768b-03e1-4e40-9ef1-c08794ccab27 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.486458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e768b-03e1-4e40-9ef1-c08794ccab27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.488474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e768b-03e1-4e40-9ef1-c08794ccab27 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.516629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 911/1846] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:06 2022] POST /identity/v3/users => generated 301 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:06.517767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e768b-03e1-4e40-9ef1-c08794ccab27 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:06.520571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539e59b-b43b-47bd-bbab-5255bfedf08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.520768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d41e768b-03e1-4e40-9ef1-c08794ccab27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:06.521661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539e59b-b43b-47bd-bbab-5255bfedf08c admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.522062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539e59b-b43b-47bd-bbab-5255bfedf08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.522431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539e59b-b43b-47bd-bbab-5255bfedf08c admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.523250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539e59b-b43b-47bd-bbab-5255bfedf08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.526404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539e59b-b43b-47bd-bbab-5255bfedf08c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.539033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e768b-03e1-4e40-9ef1-c08794ccab27 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.545358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.547197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.547197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.547197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] PATH_INFO: `/v3/users/8e6e0491c4514d038e8863115585aaef` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.548799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6e0491c4514d038e8863115585aaef)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.552360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.570778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 936/1847] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:06 2022] POST /identity/v3/users => generated 290 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:06.578416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539e59b-b43b-47bd-bbab-5255bfedf08c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:06.592679 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539e59b-b43b-47bd-bbab-5255bfedf08c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.607065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1967b9-f2b8-4e81-8c1b-a0f510379015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.608457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1967b9-f2b8-4e81-8c1b-a0f510379015 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.608984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1967b9-f2b8-4e81-8c1b-a0f510379015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.609969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1967b9-f2b8-4e81-8c1b-a0f510379015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.612501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1967b9-f2b8-4e81-8c1b-a0f510379015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.615807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1967b9-f2b8-4e81-8c1b-a0f510379015 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.626128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:06.634948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 937/1848] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:06.641535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1967b9-f2b8-4e81-8c1b-a0f510379015 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:06.645351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ca1967b9-f2b8-4e81-8c1b-a0f510379015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:06.660565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1967b9-f2b8-4e81-8c1b-a0f510379015 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.667153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d29e79-e7e4-4baa-825a-a77c15686155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.668044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d29e79-e7e4-4baa-825a-a77c15686155 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.668566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d29e79-e7e4-4baa-825a-a77c15686155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.669008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d29e79-e7e4-4baa-825a-a77c15686155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.669858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d29e79-e7e4-4baa-825a-a77c15686155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.672764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d29e79-e7e4-4baa-825a-a77c15686155 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.689447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 938/1849] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:06.689447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d29e79-e7e4-4baa-825a-a77c15686155 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:06.689765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6e0491c4514d038e8863115585aaef'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.693259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6e0491c4514d038e8863115585aaef'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.693729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6e0491c4514d038e8863115585aaef'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.710169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d29e79-e7e4-4baa-825a-a77c15686155 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.715594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6e0491c4514d038e8863115585aaef'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.718933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8802-3e36-4e2e-8fb0-05f621f6043a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.719899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8802-3e36-4e2e-8fb0-05f621f6043a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.720824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8802-3e36-4e2e-8fb0-05f621f6043a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.721272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d8802-3e36-4e2e-8fb0-05f621f6043a admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.722280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8802-3e36-4e2e-8fb0-05f621f6043a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.724216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d8802-3e36-4e2e-8fb0-05f621f6043a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.725657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6e0491c4514d038e8863115585aaef'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:06.748217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 939/1850] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:06.752730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8802-3e36-4e2e-8fb0-05f621f6043a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:06.757243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4b8d8802-3e36-4e2e-8fb0-05f621f6043a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:06.761032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 912/1851] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:06 2022] DELETE /identity/v3/users/8e6e0491c4514d038e8863115585aaef => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:06.762758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:06.764289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:06.781484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d8802-3e36-4e2e-8fb0-05f621f6043a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.898567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:06.901883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd6145-dd32-4e26-9e26-e4f32a60a6f7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:06.913139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13446eef-0cec-4aa6-b289-3f171da3844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.915764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446eef-0cec-4aa6-b289-3f171da3844e admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.917492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446eef-0cec-4aa6-b289-3f171da3844e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.918780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13446eef-0cec-4aa6-b289-3f171da3844e admin admin] PATH_INFO: `/v3/projects/fce353189b44403e8566a44db4db2198/users/460b6c7ebc314363a1d86f2033e510aa/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.928541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9ff40-322d-47f9-b6cf-a9be38a1574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:06.929791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9ff40-322d-47f9-b6cf-a9be38a1574d admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:06.930372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9ff40-322d-47f9-b6cf-a9be38a1574d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:06.930830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9ff40-322d-47f9-b6cf-a9be38a1574d admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:06.932994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9ff40-322d-47f9-b6cf-a9be38a1574d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.935233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9ff40-322d-47f9-b6cf-a9be38a1574d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.961898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13446eef-0cec-4aa6-b289-3f171da3844e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fce353189b44403e8566a44db4db2198, user_id=460b6c7ebc314363a1d86f2033e510aa, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:06.965381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13446eef-0cec-4aa6-b289-3f171da3844e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:06.971559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 940/1852] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:06.973407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9ff40-322d-47f9-b6cf-a9be38a1574d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:06.992540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9ff40-322d-47f9-b6cf-a9be38a1574d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:07.015008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 913/1853] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:06 2022] PUT /identity/v3/projects/fce353189b44403e8566a44db4db2198/users/460b6c7ebc314363a1d86f2033e510aa/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:07.016826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d75f3-dee0-4eb2-875f-4aafccf6c844 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:07.017333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d75f3-dee0-4eb2-875f-4aafccf6c844 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:07.018322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d75f3-dee0-4eb2-875f-4aafccf6c844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:07.064227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-bf0d75f3-dee0-4eb2-875f-4aafccf6c844 None None] MFA Rules not processed for user `460b6c7ebc314363a1d86f2033e510aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:07.067850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bf0d75f3-dee0-4eb2-875f-4aafccf6c844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:07.116478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc70eb6-0cfc-4586-95c0-22e1129fe7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:07.118090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc70eb6-0cfc-4586-95c0-22e1129fe7a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:07.118731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc70eb6-0cfc-4586-95c0-22e1129fe7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:07.119359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc70eb6-0cfc-4586-95c0-22e1129fe7a3 admin admin] PATH_INFO: `/v3/projects/d8ba83f6027d47848d3d90b8d4cadb0e/users/bb6ac6e86e7e427191dbe20a31e8f9c9/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:07.141824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc70eb6-0cfc-4586-95c0-22e1129fe7a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ba83f6027d47848d3d90b8d4cadb0e, user_id=bb6ac6e86e7e427191dbe20a31e8f9c9, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:07.151224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc70eb6-0cfc-4586-95c0-22e1129fe7a3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:07.188906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 941/1854] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:06 2022] PUT /identity/v3/projects/d8ba83f6027d47848d3d90b8d4cadb0e/users/bb6ac6e86e7e427191dbe20a31e8f9c9/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:07.200369 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f6b6-3272-4500-bddd-879f8810e91c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:07.200820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f6b6-3272-4500-bddd-879f8810e91c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:07.201265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3f6b6-3272-4500-bddd-879f8810e91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:07.240897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 914/1855] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:07.244817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d75f3-dee0-4eb2-875f-4aafccf6c844 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:07.259460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0dd3f6b6-3272-4500-bddd-879f8810e91c None None] MFA Rules not processed for user `bb6ac6e86e7e427191dbe20a31e8f9c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:07.260766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0dd3f6b6-3272-4500-bddd-879f8810e91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:07.312217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d75f3-dee0-4eb2-875f-4aafccf6c844 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:07.344650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:07.348240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 942/1856] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:07.352654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3f6b6-3272-4500-bddd-879f8810e91c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:07.410619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8086e-5752-4b63-bc4b-ffa050371336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:07.411301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8086e-5752-4b63-bc4b-ffa050371336 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:07.411595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8086e-5752-4b63-bc4b-ffa050371336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:07.411872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8086e-5752-4b63-bc4b-ffa050371336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:07.412588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8086e-5752-4b63-bc4b-ffa050371336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:07.414601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8086e-5752-4b63-bc4b-ffa050371336 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:07.457240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 915/1857] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:07 2022] POST /identity/v3/projects => generated 401 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:07.463287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8086e-5752-4b63-bc4b-ffa050371336 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:07.483312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3f6b6-3272-4500-bddd-879f8810e91c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:07.500196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:07.552774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8086e-5752-4b63-bc4b-ffa050371336 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:07.561654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56378d-812b-4984-8672-a29999d831d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:07.562559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56378d-812b-4984-8672-a29999d831d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:07.563270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56378d-812b-4984-8672-a29999d831d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:07.563653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56378d-812b-4984-8672-a29999d831d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:07.572937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56378d-812b-4984-8672-a29999d831d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:07.575128 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56378d-812b-4984-8672-a29999d831d8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:07.628382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 916/1858] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:07 2022] POST /identity/v3/users => generated 307 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:07.631751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56378d-812b-4984-8672-a29999d831d8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:07.659956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56378d-812b-4984-8672-a29999d831d8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:07.668060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c597f-854d-491e-a7ca-eff669ac81ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:07.668795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c597f-854d-491e-a7ca-eff669ac81ee admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:07.669145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6c75b-3c49-456b-90c0-9ab3d01a2f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:07.669304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c597f-854d-491e-a7ca-eff669ac81ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:07.669642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c597f-854d-491e-a7ca-eff669ac81ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:07.670137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6c75b-3c49-456b-90c0-9ab3d01a2f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:07.670473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c597f-854d-491e-a7ca-eff669ac81ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:07.670745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6c75b-3c49-456b-90c0-9ab3d01a2f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:07.670945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6c75b-3c49-456b-90c0-9ab3d01a2f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:07.672401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6c75b-3c49-456b-90c0-9ab3d01a2f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:07.673167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c597f-854d-491e-a7ca-eff669ac81ee admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:07.675425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6c75b-3c49-456b-90c0-9ab3d01a2f7c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:07.705433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 917/1859] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:07.713997 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6c75b-3c49-456b-90c0-9ab3d01a2f7c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:07.727762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6c75b-3c49-456b-90c0-9ab3d01a2f7c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:07.732805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 943/1860] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:07 2022] POST /identity/v3/projects => generated 379 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:07.736590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39611812-3b5b-4e29-b34b-b9e851333640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:07.742542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c597f-854d-491e-a7ca-eff669ac81ee admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:07.742893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611812-3b5b-4e29-b34b-b9e851333640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:07.742893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611812-3b5b-4e29-b34b-b9e851333640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:07.742893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39611812-3b5b-4e29-b34b-b9e851333640 admin admin] PATH_INFO: `/v3/projects/ce97bea515f04ddfb87fd4a762e22d01/users/78d8917e909743a88bbb7c64ed5891fd/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:07.821240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39611812-3b5b-4e29-b34b-b9e851333640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce97bea515f04ddfb87fd4a762e22d01, user_id=78d8917e909743a88bbb7c64ed5891fd, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:07.825767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39611812-3b5b-4e29-b34b-b9e851333640 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:07.857849 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 918/1861] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:07 2022] PUT /identity/v3/projects/ce97bea515f04ddfb87fd4a762e22d01/users/78d8917e909743a88bbb7c64ed5891fd/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:07.865197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39611812-3b5b-4e29-b34b-b9e851333640 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:07.932817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c597f-854d-491e-a7ca-eff669ac81ee admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.058188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39611812-3b5b-4e29-b34b-b9e851333640 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.071651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd40bc8-2f4c-45b8-8542-b3d14c51d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.082685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd40bc8-2f4c-45b8-8542-b3d14c51d8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.082685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd40bc8-2f4c-45b8-8542-b3d14c51d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.082685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd40bc8-2f4c-45b8-8542-b3d14c51d8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.082685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd40bc8-2f4c-45b8-8542-b3d14c51d8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.083654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd40bc8-2f4c-45b8-8542-b3d14c51d8f4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.086228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7ade2-5c4d-4a25-bdb4-334d26309bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.087113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7ade2-5c4d-4a25-bdb4-334d26309bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.087581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7ade2-5c4d-4a25-bdb4-334d26309bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.088318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7ade2-5c4d-4a25-bdb4-334d26309bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.088653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:08.089609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7ade2-5c4d-4a25-bdb4-334d26309bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.092655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7ade2-5c4d-4a25-bdb4-334d26309bd2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.118157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 919/1862] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:08.119698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd40bc8-2f4c-45b8-8542-b3d14c51d8f4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.131760 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 944/1863] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:07 2022] POST /identity/v3/users => generated 290 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:08.133577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd40bc8-2f4c-45b8-8542-b3d14c51d8f4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.137000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7ade2-5c4d-4a25-bdb4-334d26309bd2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.139689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13a027-9c7e-4933-99d0-6dd8bd9044b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.141401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13a027-9c7e-4933-99d0-6dd8bd9044b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.141688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13a027-9c7e-4933-99d0-6dd8bd9044b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.144657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13a027-9c7e-4933-99d0-6dd8bd9044b7 admin admin] PATH_INFO: `/v3/projects/ce97bea515f04ddfb87fd4a762e22d01/users/78d8917e909743a88bbb7c64ed5891fd/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.149338 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13a027-9c7e-4933-99d0-6dd8bd9044b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce97bea515f04ddfb87fd4a762e22d01, user_id=78d8917e909743a88bbb7c64ed5891fd, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.150000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7ade2-5c4d-4a25-bdb4-334d26309bd2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.156803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13a027-9c7e-4933-99d0-6dd8bd9044b7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.159614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5234b-b96c-42ea-8dca-32086111f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.160320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5234b-b96c-42ea-8dca-32086111f473 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.161081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5234b-b96c-42ea-8dca-32086111f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.161081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5234b-b96c-42ea-8dca-32086111f473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.161836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5234b-b96c-42ea-8dca-32086111f473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.164281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5234b-b96c-42ea-8dca-32086111f473 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.188408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 945/1865] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:08.188408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5234b-b96c-42ea-8dca-32086111f473 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.190410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 920/1865] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:08 2022] PUT /identity/v3/projects/ce97bea515f04ddfb87fd4a762e22d01/users/78d8917e909743a88bbb7c64ed5891fd/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:08.193096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d213ce7-9b0e-447d-975e-380fe6fde26c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.193520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d213ce7-9b0e-447d-975e-380fe6fde26c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.193894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d213ce7-9b0e-447d-975e-380fe6fde26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.196028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5234b-b96c-42ea-8dca-32086111f473 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.216830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:08.236732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5d213ce7-9b0e-447d-975e-380fe6fde26c None None] MFA Rules not processed for user `78d8917e909743a88bbb7c64ed5891fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:08.239203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5d213ce7-9b0e-447d-975e-380fe6fde26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:08.284866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff0929-c0c0-4b72-a0f9-7628da646a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.284866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff0929-c0c0-4b72-a0f9-7628da646a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.284866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff0929-c0c0-4b72-a0f9-7628da646a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.284866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff0929-c0c0-4b72-a0f9-7628da646a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.285411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff0929-c0c0-4b72-a0f9-7628da646a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.287196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff0929-c0c0-4b72-a0f9-7628da646a88 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.298485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 946/1866] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:08.299467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff0929-c0c0-4b72-a0f9-7628da646a88 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.301185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ffff0929-c0c0-4b72-a0f9-7628da646a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:08.314788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff0929-c0c0-4b72-a0f9-7628da646a88 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.320945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.321971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.322123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.322393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] PATH_INFO: `/v3/projects/369f115da74a4a5b82fd61ba122b5d0b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.323584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=369f115da74a4a5b82fd61ba122b5d0b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.325557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.335575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 921/1867] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:08.335575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d213ce7-9b0e-447d-975e-380fe6fde26c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.347730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d213ce7-9b0e-447d-975e-380fe6fde26c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.353951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c1bd-a509-47cb-9e8b-395ac19a20ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.355019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c1bd-a509-47cb-9e8b-395ac19a20ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.355326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c1bd-a509-47cb-9e8b-395ac19a20ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.355717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c1bd-a509-47cb-9e8b-395ac19a20ec admin admin] PATH_INFO: `/v3/projects/af3d6604a01441d698b7a14be20afb6a/users/68b46c8452964d00a1644fafec9f6cd5/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.381544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4c1bd-a509-47cb-9e8b-395ac19a20ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3d6604a01441d698b7a14be20afb6a, user_id=68b46c8452964d00a1644fafec9f6cd5, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.385534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4c1bd-a509-47cb-9e8b-395ac19a20ec admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.410424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '369f115da74a4a5b82fd61ba122b5d0b', 'request_id': 'req-cdd121a7-f637-474c-bf94-ca7ad7e942f0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:08.416579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 922/1868] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:08 2022] PUT /identity/v3/projects/af3d6604a01441d698b7a14be20afb6a/users/68b46c8452964d00a1644fafec9f6cd5/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:08.418499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c1bd-a509-47cb-9e8b-395ac19a20ec admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.421815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-43d4c1bd-a509-47cb-9e8b-395ac19a20ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:08.424156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '369f115da74a4a5b82fd61ba122b5d0b', 'request_id': 'req-cdd121a7-f637-474c-bf94-ca7ad7e942f0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:08.439430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '369f115da74a4a5b82fd61ba122b5d0b', 'request_id': 'req-cdd121a7-f637-474c-bf94-ca7ad7e942f0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:08.469025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] The token cache is being invalidate because project 369f115da74a4a5b82fd61ba122b5d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:08.469327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:08.470423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-cdd121a7-f637-474c-bf94-ca7ad7e942f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:08.478045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 947/1869] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:08 2022] DELETE /identity/v3/projects/369f115da74a4a5b82fd61ba122b5d0b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:08.479621 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612e9c0-fe61-47d3-b707-bcee3bbe4893 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.479909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612e9c0-fe61-47d3-b707-bcee3bbe4893 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.480188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612e9c0-fe61-47d3-b707-bcee3bbe4893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.516589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2612e9c0-fe61-47d3-b707-bcee3bbe4893 None None] MFA Rules not processed for user `68b46c8452964d00a1644fafec9f6cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:08.517882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2612e9c0-fe61-47d3-b707-bcee3bbe4893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:08.534968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c1bd-a509-47cb-9e8b-395ac19a20ec admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.540745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.542743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.543196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.543795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.546351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:08.599079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 948/1870] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:08.601083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99178ec9-3320-4941-95d9-4c6aba4831f6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.601970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99178ec9-3320-4941-95d9-4c6aba4831f6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.602332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99178ec9-3320-4941-95d9-4c6aba4831f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.630963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-99178ec9-3320-4941-95d9-4c6aba4831f6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:08.634714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-99178ec9-3320-4941-95d9-4c6aba4831f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:08.650451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:08.658024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.664048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.667742 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:08.695851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 923/1871] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:08 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:08.697602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.702467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:08.725474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 949/1872] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:08.727818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c23c64-6350-4c11-b5e5-154d4155281e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.728314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c23c64-6350-4c11-b5e5-154d4155281e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.728758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c23c64-6350-4c11-b5e5-154d4155281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.729794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae0018-c1b4-4b56-a1f7-e85dcd15d5d4 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.757692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159314-507a-4449-af2e-8fcc75991676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.758703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159314-507a-4449-af2e-8fcc75991676 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.759368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159314-507a-4449-af2e-8fcc75991676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.760002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8159314-507a-4449-af2e-8fcc75991676 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.760907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8159314-507a-4449-af2e-8fcc75991676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.763506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8159314-507a-4449-af2e-8fcc75991676 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.773966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-65c23c64-6350-4c11-b5e5-154d4155281e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:08.776220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-65c23c64-6350-4c11-b5e5-154d4155281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:08.790597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 950/1873] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:08.795930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c23c64-6350-4c11-b5e5-154d4155281e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.810329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c23c64-6350-4c11-b5e5-154d4155281e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.810523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 924/1874] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:08 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:08.815143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159314-507a-4449-af2e-8fcc75991676 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.941075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.941075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.941075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.941075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.953489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8159314-507a-4449-af2e-8fcc75991676 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:08.962913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:08.963028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.964932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.966181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da333-05cb-4e2b-9cb5-b65c51c925a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:08.967024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da333-05cb-4e2b-9cb5-b65c51c925a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:08.967307 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da333-05cb-4e2b-9cb5-b65c51c925a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:08.969913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7da333-05cb-4e2b-9cb5-b65c51c925a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:08.970977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7da333-05cb-4e2b-9cb5-b65c51c925a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:08.976538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7da333-05cb-4e2b-9cb5-b65c51c925a1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:08.978689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 951/1875] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:08.979742 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:08.984233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:09.022738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 925/1876] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:08 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:09.022738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da333-05cb-4e2b-9cb5-b65c51c925a1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.024916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6a7da333-05cb-4e2b-9cb5-b65c51c925a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:09.091961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b463127-9eff-4333-9ffb-ec678bead5dc admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.097532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019b7b6-94cd-404f-b012-65736981d9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.098760 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019b7b6-94cd-404f-b012-65736981d9cc service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.099065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019b7b6-94cd-404f-b012-65736981d9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.099340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019b7b6-94cd-404f-b012-65736981d9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.101706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4019b7b6-94cd-404f-b012-65736981d9cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:09.121926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7da333-05cb-4e2b-9cb5-b65c51c925a1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.126815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3ff38-5ae4-4c0b-ae6c-80c53099e0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.127775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3ff38-5ae4-4c0b-ae6c-80c53099e0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.128094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3ff38-5ae4-4c0b-ae6c-80c53099e0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.128329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3ff38-5ae4-4c0b-ae6c-80c53099e0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.132897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0f3ff38-5ae4-4c0b-ae6c-80c53099e0b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:09.196678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019b7b6-94cd-404f-b012-65736981d9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.198847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019b7b6-94cd-404f-b012-65736981d9cc service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.229786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 952/1877] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:09.230656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019b7b6-94cd-404f-b012-65736981d9cc service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.243639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019b7b6-94cd-404f-b012-65736981d9cc service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.247986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3ff38-5ae4-4c0b-ae6c-80c53099e0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.249224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d4b6f-00e6-4067-be6d-723cf7653ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.250479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d4b6f-00e6-4067-be6d-723cf7653ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.250779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d4b6f-00e6-4067-be6d-723cf7653ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.250962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3ff38-5ae4-4c0b-ae6c-80c53099e0b1 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.251108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d4b6f-00e6-4067-be6d-723cf7653ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.251970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d4b6f-00e6-4067-be6d-723cf7653ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.254248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d4b6f-00e6-4067-be6d-723cf7653ed2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.263344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 926/1878] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:09.264557 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3ff38-5ae4-4c0b-ae6c-80c53099e0b1 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.277546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3ff38-5ae4-4c0b-ae6c-80c53099e0b1 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.281218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:09.284222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dec64-dd3e-40df-891e-51a558c5109b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.285487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dec64-dd3e-40df-891e-51a558c5109b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.286004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dec64-dd3e-40df-891e-51a558c5109b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.286479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602dec64-dd3e-40df-891e-51a558c5109b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.287433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dec64-dd3e-40df-891e-51a558c5109b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.289652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602dec64-dd3e-40df-891e-51a558c5109b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.297767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:09.310167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 927/1879] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:09.311427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dec64-dd3e-40df-891e-51a558c5109b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.323945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 953/1880] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:09 2022] POST /identity/v3/projects => generated 367 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:09.324161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602dec64-dd3e-40df-891e-51a558c5109b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.325067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d4b6f-00e6-4067-be6d-723cf7653ed2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.418577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a10cf-c808-4d01-8a22-939793027043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.419518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a10cf-c808-4d01-8a22-939793027043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.419800 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a10cf-c808-4d01-8a22-939793027043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.420077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a10cf-c808-4d01-8a22-939793027043 admin admin] PATH_INFO: `/v3/projects/b2f7216f4ec64142bdc6c945b0b5af50/users/5b488627446a4b2c9b7f8445e0040030/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.463815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d4b6f-00e6-4067-be6d-723cf7653ed2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.471952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a706a8c-3ae8-4317-8579-0dd720c8e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.473359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a706a8c-3ae8-4317-8579-0dd720c8e03e admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.473748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a706a8c-3ae8-4317-8579-0dd720c8e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.474129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a706a8c-3ae8-4317-8579-0dd720c8e03e admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.476055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a706a8c-3ae8-4317-8579-0dd720c8e03e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.476347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a10cf-c808-4d01-8a22-939793027043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f7216f4ec64142bdc6c945b0b5af50, user_id=5b488627446a4b2c9b7f8445e0040030, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.479077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a10cf-c808-4d01-8a22-939793027043 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.479228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a706a8c-3ae8-4317-8579-0dd720c8e03e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.514163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 954/1881] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:09 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:09.518744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a706a8c-3ae8-4317-8579-0dd720c8e03e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.525862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 928/1882] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:09 2022] PUT /identity/v3/projects/b2f7216f4ec64142bdc6c945b0b5af50/users/5b488627446a4b2c9b7f8445e0040030/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:09.526853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a10cf-c808-4d01-8a22-939793027043 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.536658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a706a8c-3ae8-4317-8579-0dd720c8e03e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.646122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc655b4-f553-4fbd-9a8d-7edb0ad48910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.648014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc655b4-f553-4fbd-9a8d-7edb0ad48910 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.648966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc655b4-f553-4fbd-9a8d-7edb0ad48910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.651440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc655b4-f553-4fbd-9a8d-7edb0ad48910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.653202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc655b4-f553-4fbd-9a8d-7edb0ad48910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.658982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc655b4-f553-4fbd-9a8d-7edb0ad48910 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.676962 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 955/1883] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:09.682087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc655b4-f553-4fbd-9a8d-7edb0ad48910 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.693360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a10cf-c808-4d01-8a22-939793027043 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.699983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3e8db-0f59-447c-9a7a-81791f5acf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.700741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3e8db-0f59-447c-9a7a-81791f5acf16 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.702506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc655b4-f553-4fbd-9a8d-7edb0ad48910 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.708677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3e8db-0f59-447c-9a7a-81791f5acf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.708980 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f0024-4435-4b42-af37-56a64b67a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.709681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f0024-4435-4b42-af37-56a64b67a2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.710016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f0024-4435-4b42-af37-56a64b67a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.710297 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f0024-4435-4b42-af37-56a64b67a2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.711139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f0024-4435-4b42-af37-56a64b67a2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.713205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f0024-4435-4b42-af37-56a64b67a2b3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.723483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3e8db-0f59-447c-9a7a-81791f5acf16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.724364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3e8db-0f59-447c-9a7a-81791f5acf16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.727884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3e8db-0f59-447c-9a7a-81791f5acf16 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.732780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 956/1884] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:09.735874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f0024-4435-4b42-af37-56a64b67a2b3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.766297 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f0024-4435-4b42-af37-56a64b67a2b3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.782535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd1167-f478-426d-bfea-8888c2971c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.783468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd1167-f478-426d-bfea-8888c2971c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.783759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd1167-f478-426d-bfea-8888c2971c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.784030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd1167-f478-426d-bfea-8888c2971c60 admin admin] PATH_INFO: `/v3/projects/27462a9ccf304926a5bf52f3507b38a5/users/7547de0baa574057886de96069c2290b/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.790295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 929/1885] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:09.792736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3e8db-0f59-447c-9a7a-81791f5acf16 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:09.829874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3e8db-0f59-447c-9a7a-81791f5acf16 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:09.838967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd1167-f478-426d-bfea-8888c2971c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27462a9ccf304926a5bf52f3507b38a5, user_id=7547de0baa574057886de96069c2290b, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.841704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd1167-f478-426d-bfea-8888c2971c60 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.865353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d780ccb-249d-4cbb-afbf-3d2ba357abf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:09.866864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780ccb-249d-4cbb-afbf-3d2ba357abf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.866864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780ccb-249d-4cbb-afbf-3d2ba357abf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.867079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d780ccb-249d-4cbb-afbf-3d2ba357abf1 admin admin] PATH_INFO: `/v3/projects/b2f7216f4ec64142bdc6c945b0b5af50/users/5b488627446a4b2c9b7f8445e0040030/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.873079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d780ccb-249d-4cbb-afbf-3d2ba357abf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f7216f4ec64142bdc6c945b0b5af50, user_id=5b488627446a4b2c9b7f8445e0040030, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:09.875998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d780ccb-249d-4cbb-afbf-3d2ba357abf1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:09.881658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 957/1886] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:09 2022] PUT /identity/v3/projects/27462a9ccf304926a5bf52f3507b38a5/users/7547de0baa574057886de96069c2290b/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:09.897610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e4d0d-aa9e-474b-99c2-4382f9ff2636 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.897903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e4d0d-aa9e-474b-99c2-4382f9ff2636 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.898188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e4d0d-aa9e-474b-99c2-4382f9ff2636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.937962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 930/1887] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:09 2022] PUT /identity/v3/projects/b2f7216f4ec64142bdc6c945b0b5af50/users/5b488627446a4b2c9b7f8445e0040030/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:09.951228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4899e-483b-4955-bdd1-20a77ea425e8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:09.951572 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4899e-483b-4955-bdd1-20a77ea425e8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:09.951853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4899e-483b-4955-bdd1-20a77ea425e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:09.954199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cb7e4d0d-aa9e-474b-99c2-4382f9ff2636 None None] MFA Rules not processed for user `7547de0baa574057886de96069c2290b`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:09.955457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cb7e4d0d-aa9e-474b-99c2-4382f9ff2636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:09.991105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8dc4899e-483b-4955-bdd1-20a77ea425e8 None None] MFA Rules not processed for user `5b488627446a4b2c9b7f8445e0040030`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:09.993513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8dc4899e-483b-4955-bdd1-20a77ea425e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:10.046744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:10.067861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:10.110583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 931/1888] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:10.121272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 958/1889] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:10.124516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4899e-483b-4955-bdd1-20a77ea425e8 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:10.125929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e4d0d-aa9e-474b-99c2-4382f9ff2636 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:10.227206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4899e-483b-4955-bdd1-20a77ea425e8 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:10.234655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e4d0d-aa9e-474b-99c2-4382f9ff2636 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:10.238031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd379f8-aa3b-47bb-af4d-73c2858d75aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:10.238891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd379f8-aa3b-47bb-af4d-73c2858d75aa admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:10.239235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd379f8-aa3b-47bb-af4d-73c2858d75aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:10.239514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd379f8-aa3b-47bb-af4d-73c2858d75aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:10.240321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd379f8-aa3b-47bb-af4d-73c2858d75aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:10.241075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcc9c8-dedd-4d50-8273-020c9a1baec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:10.243202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd379f8-aa3b-47bb-af4d-73c2858d75aa admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:10.243883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcc9c8-dedd-4d50-8273-020c9a1baec8 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:10.244336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcc9c8-dedd-4d50-8273-020c9a1baec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:10.244781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcc9c8-dedd-4d50-8273-020c9a1baec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:10.260377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcc9c8-dedd-4d50-8273-020c9a1baec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:10.264052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcc9c8-dedd-4d50-8273-020c9a1baec8 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:10.285233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 959/1890] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:10.297716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 932/1891] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:10 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:10.299275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcc9c8-dedd-4d50-8273-020c9a1baec8 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:10.316481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcc9c8-dedd-4d50-8273-020c9a1baec8 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:10.356025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd379f8-aa3b-47bb-af4d-73c2858d75aa admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:10.442515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266d339-32cf-4dfd-8653-bff2ea0529c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:10.443412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266d339-32cf-4dfd-8653-bff2ea0529c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:10.443802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266d339-32cf-4dfd-8653-bff2ea0529c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:10.444178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266d339-32cf-4dfd-8653-bff2ea0529c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:10.445060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266d339-32cf-4dfd-8653-bff2ea0529c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:10.447381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266d339-32cf-4dfd-8653-bff2ea0529c6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:10.478775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd379f8-aa3b-47bb-af4d-73c2858d75aa admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:10.494977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31ef2a-2be0-407e-a63c-6a2ec4c0a0a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:10.497335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31ef2a-2be0-407e-a63c-6a2ec4c0a0a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:10.497742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31ef2a-2be0-407e-a63c-6a2ec4c0a0a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:10.498129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31ef2a-2be0-407e-a63c-6a2ec4c0a0a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:10.498612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 960/1892] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:10 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:10.502115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266d339-32cf-4dfd-8653-bff2ea0529c6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:10.503308 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2e31ef2a-2be0-407e-a63c-6a2ec4c0a0a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:10.525835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266d339-32cf-4dfd-8653-bff2ea0529c6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:10.538299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2629-69d4-49af-ab39-19ec76ad5935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:10.541234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2629-69d4-49af-ab39-19ec76ad5935 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:10.541942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2629-69d4-49af-ab39-19ec76ad5935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:10.543312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f2629-69d4-49af-ab39-19ec76ad5935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:10.544343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f2629-69d4-49af-ab39-19ec76ad5935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:10.549867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f2629-69d4-49af-ab39-19ec76ad5935 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:10.576763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 961/1893] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:10.582195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2629-69d4-49af-ab39-19ec76ad5935 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:10.595875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f2629-69d4-49af-ab39-19ec76ad5935 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:10.603474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e37dc-bc23-4aaa-9fb2-e5e4accdccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:10.604550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e37dc-bc23-4aaa-9fb2-e5e4accdccb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:10.605751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e37dc-bc23-4aaa-9fb2-e5e4accdccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:10.607372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e37dc-bc23-4aaa-9fb2-e5e4accdccb7 admin admin] PATH_INFO: `/v3/projects/9727a48a5c1a454fb6f7a985127c6252/users/b69061d1df0b4d74a80032e85479a35f/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:10.637403 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e37dc-bc23-4aaa-9fb2-e5e4accdccb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9727a48a5c1a454fb6f7a985127c6252, user_id=b69061d1df0b4d74a80032e85479a35f, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:10.640428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e37dc-bc23-4aaa-9fb2-e5e4accdccb7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:10.641014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31ef2a-2be0-407e-a63c-6a2ec4c0a0a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:10.642787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31ef2a-2be0-407e-a63c-6a2ec4c0a0a4 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:10.661142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 933/1894] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:10.680104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 962/1895] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:10 2022] PUT /identity/v3/projects/9727a48a5c1a454fb6f7a985127c6252/users/b69061d1df0b4d74a80032e85479a35f/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:10.685489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31ef2a-2be0-407e-a63c-6a2ec4c0a0a4 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:10.699486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31ef2a-2be0-407e-a63c-6a2ec4c0a0a4 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:10.780206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:10.829135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe5c5d-4f24-4f89-a916-052646dc0c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:10.832652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe5c5d-4f24-4f89-a916-052646dc0c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:10.836932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe5c5d-4f24-4f89-a916-052646dc0c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:10.837384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe5c5d-4f24-4f89-a916-052646dc0c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:10.842975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe5c5d-4f24-4f89-a916-052646dc0c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:10.851424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe5c5d-4f24-4f89-a916-052646dc0c05 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:10.884383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 934/1896] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:10.889485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e37dc-bc23-4aaa-9fb2-e5e4accdccb7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:10.908459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e37dc-bc23-4aaa-9fb2-e5e4accdccb7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:10.914519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82363743-1b04-4f40-ac74-e8226f1aad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:10.915855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82363743-1b04-4f40-ac74-e8226f1aad09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:10.916142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82363743-1b04-4f40-ac74-e8226f1aad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:10.916418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82363743-1b04-4f40-ac74-e8226f1aad09 admin admin] PATH_INFO: `/v3/projects/9727a48a5c1a454fb6f7a985127c6252/users/b69061d1df0b4d74a80032e85479a35f/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:10.922532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82363743-1b04-4f40-ac74-e8226f1aad09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9727a48a5c1a454fb6f7a985127c6252, user_id=b69061d1df0b4d74a80032e85479a35f, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:10.932100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82363743-1b04-4f40-ac74-e8226f1aad09 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:10.953408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 963/1897] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:10 2022] PUT /identity/v3/projects/9727a48a5c1a454fb6f7a985127c6252/users/b69061d1df0b4d74a80032e85479a35f/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:10.963641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf9c86-9037-4ad5-99b8-28c86b7b38d7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:10.964121 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf9c86-9037-4ad5-99b8-28c86b7b38d7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:10.966593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf9c86-9037-4ad5-99b8-28c86b7b38d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:11.004118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-68cf9c86-9037-4ad5-99b8-28c86b7b38d7 None None] MFA Rules not processed for user `b69061d1df0b4d74a80032e85479a35f`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:11.005985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-68cf9c86-9037-4ad5-99b8-28c86b7b38d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:11.126666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 935/1898] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:11.216771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82363743-1b04-4f40-ac74-e8226f1aad09 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:11.279383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:11.387384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82363743-1b04-4f40-ac74-e8226f1aad09 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:11.394769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f3d80-853f-4cf1-89f1-44e835c3c6fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:11.395449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3d80-853f-4cf1-89f1-44e835c3c6fd service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:11.395731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3d80-853f-4cf1-89f1-44e835c3c6fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:11.396005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f3d80-853f-4cf1-89f1-44e835c3c6fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:11.416173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f3d80-853f-4cf1-89f1-44e835c3c6fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:11.417687 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f3d80-853f-4cf1-89f1-44e835c3c6fd service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:11.457594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 964/1899] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:12.314023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd0af-a5cc-485d-b7bc-b37425001dca None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:12.314551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd0af-a5cc-485d-b7bc-b37425001dca None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:12.314646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddd0af-a5cc-485d-b7bc-b37425001dca None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:12.316165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 936/1900] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:31:12.338310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9979b-c020-4528-b76b-8abbd4abc059 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:12.338835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9979b-c020-4528-b76b-8abbd4abc059 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:12.339087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9979b-c020-4528-b76b-8abbd4abc059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:12.388938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d3f9979b-c020-4528-b76b-8abbd4abc059 None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:12.390512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d3f9979b-c020-4528-b76b-8abbd4abc059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:12.639998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 965/1901] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:31:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:12.660743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd0af-a5cc-485d-b7bc-b37425001dca None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:12.662577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e1ddd0af-a5cc-485d-b7bc-b37425001dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:12.718187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddd0af-a5cc-485d-b7bc-b37425001dca None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:12.737490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af5109-4a75-4119-a5c7-263224093920 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:12.738117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af5109-4a75-4119-a5c7-263224093920 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:12.738552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af5109-4a75-4119-a5c7-263224093920 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:12.738662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af5109-4a75-4119-a5c7-263224093920 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:12.762271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af5109-4a75-4119-a5c7-263224093920 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:12.763894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af5109-4a75-4119-a5c7-263224093920 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:12.776933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 937/1902] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:13.761077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9979b-c020-4528-b76b-8abbd4abc059 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:13.823338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9979b-c020-4528-b76b-8abbd4abc059 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:13.827846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:13.828721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:13.829033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:13.829307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] PATH_INFO: `/v3/users/7547de0baa574057886de96069c2290b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:13.830492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7547de0baa574057886de96069c2290b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:13.832430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:13.887422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7547de0baa574057886de96069c2290b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:13.888128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7547de0baa574057886de96069c2290b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:13.891951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:13.898525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7547de0baa574057886de96069c2290b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:13.907342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7547de0baa574057886de96069c2290b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:13.908229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7547de0baa574057886de96069c2290b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:13.925507 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 966/1903] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:13 2022] DELETE /identity/v3/users/7547de0baa574057886de96069c2290b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:13.930340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d224e7-9efe-4e2c-b4ea-6553338c12bf None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:13.930799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d224e7-9efe-4e2c-b4ea-6553338c12bf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:13.930886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d224e7-9efe-4e2c-b4ea-6553338c12bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:13.949663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f2d224e7-9efe-4e2c-b4ea-6553338c12bf None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:13.950900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f2d224e7-9efe-4e2c-b4ea-6553338c12bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:14.012391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 938/1904] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:14.022536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:14.024023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:14.085998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075f80a-a832-4bd4-b0c1-db14413f228d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:14.090034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb3da5-1c78-4fc5-be73-8cbedf52fc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:14.090686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3da5-1c78-4fc5-be73-8cbedf52fc51 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:14.090969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3da5-1c78-4fc5-be73-8cbedf52fc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:14.091247 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb3da5-1c78-4fc5-be73-8cbedf52fc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:14.101021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb3da5-1c78-4fc5-be73-8cbedf52fc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:14.102472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb3da5-1c78-4fc5-be73-8cbedf52fc51 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:14.112220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 967/1905] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:14.435392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d224e7-9efe-4e2c-b4ea-6553338c12bf None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:14.437833 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f2d224e7-9efe-4e2c-b4ea-6553338c12bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:14.460440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d224e7-9efe-4e2c-b4ea-6553338c12bf None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:14.469622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:14.473274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:14.473886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:14.474294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] PATH_INFO: `/v3/projects/27462a9ccf304926a5bf52f3507b38a5` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:14.476473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27462a9ccf304926a5bf52f3507b38a5)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:14.476613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb3da5-1c78-4fc5-be73-8cbedf52fc51 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:14.478278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e3cb3da5-1c78-4fc5-be73-8cbedf52fc51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:14.492533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb3da5-1c78-4fc5-be73-8cbedf52fc51 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:14.496762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:14.503400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:14.504308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:14.504590 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:14.504892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] PATH_INFO: `/v3/users/460b6c7ebc314363a1d86f2033e510aa` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:14.506755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=460b6c7ebc314363a1d86f2033e510aa)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:14.510567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:14.593553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:14.608517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460b6c7ebc314363a1d86f2033e510aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.609268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27462a9ccf304926a5bf52f3507b38a5', 'request_id': 'req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.611260 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460b6c7ebc314363a1d86f2033e510aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.625789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27462a9ccf304926a5bf52f3507b38a5', 'request_id': 'req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.626455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460b6c7ebc314363a1d86f2033e510aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.643425 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460b6c7ebc314363a1d86f2033e510aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.644669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460b6c7ebc314363a1d86f2033e510aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.653636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27462a9ccf304926a5bf52f3507b38a5', 'request_id': 'req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.673047 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] The token cache is being invalidate because project 27462a9ccf304926a5bf52f3507b38a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:14.673499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.677283 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11ed8332-78b2-4a8b-bcd3-4e493fd2ae58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.677995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 968/1906] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:14 2022] DELETE /identity/v3/users/460b6c7ebc314363a1d86f2033e510aa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:14.679465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:14.682618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 939/1907] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:14 2022] DELETE /identity/v3/projects/27462a9ccf304926a5bf52f3507b38a5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:14.682618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ce309-f986-4716-b3e3-7b1a20d94560 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:14.682618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ce309-f986-4716-b3e3-7b1a20d94560 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:14.683096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ce309-f986-4716-b3e3-7b1a20d94560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:14.685474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:14.718343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b11ce309-f986-4716-b3e3-7b1a20d94560 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:14.721718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b11ce309-f986-4716-b3e3-7b1a20d94560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:14.790956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:14.821313 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2eb3b-46b3-4997-b683-43f283922463 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:14.827308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:14.828229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:14.828506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:14.828783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] PATH_INFO: `/v3/users/bb6ac6e86e7e427191dbe20a31e8f9c9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:14.830110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6ac6e86e7e427191dbe20a31e8f9c9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:14.832176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:14.886025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 940/1908] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:14.886950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ce309-f986-4716-b3e3-7b1a20d94560 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:14.889968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b11ce309-f986-4716-b3e3-7b1a20d94560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:14.905584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ce309-f986-4716-b3e3-7b1a20d94560 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:14.911139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6ac6e86e7e427191dbe20a31e8f9c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.912791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:14.914195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:14.914802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:14.915152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] PATH_INFO: `/v3/users/b69061d1df0b4d74a80032e85479a35f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:14.916533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69061d1df0b4d74a80032e85479a35f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:14.919021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:14.921302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6ac6e86e7e427191dbe20a31e8f9c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.940363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6ac6e86e7e427191dbe20a31e8f9c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.948978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6ac6e86e7e427191dbe20a31e8f9c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.950129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6ac6e86e7e427191dbe20a31e8f9c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:14.987403 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 969/1909] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:14 2022] DELETE /identity/v3/users/bb6ac6e86e7e427191dbe20a31e8f9c9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:14.992120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:14.996882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:15.018542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69061d1df0b4d74a80032e85479a35f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:15.019276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69061d1df0b4d74a80032e85479a35f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:15.020668 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69061d1df0b4d74a80032e85479a35f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:15.038195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69061d1df0b4d74a80032e85479a35f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:15.048621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-36d2fb41-aa59-4e66-976f-1fcf0098d6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69061d1df0b4d74a80032e85479a35f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:15.082513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 941/1910] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:14 2022] DELETE /identity/v3/users/b69061d1df0b4d74a80032e85479a35f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:15.083907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f42bd-750f-41d9-9f1d-794115aef1d7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:15.084151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f42bd-750f-41d9-9f1d-794115aef1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:15.084429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f42bd-750f-41d9-9f1d-794115aef1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:15.136957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fefbf1-8c23-432b-8b56-9973e2c8d774 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:15.157497 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-251f42bd-750f-41d9-9f1d-794115aef1d7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:15.158766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-251f42bd-750f-41d9-9f1d-794115aef1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:15.261227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:15.274463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:15.275412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:15.275840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:15.276264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:15.282020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:15.352433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 942/1911] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:15.396477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:15.465278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:15.467548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:15.483408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 970/1912] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:15.488717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f42bd-750f-41d9-9f1d-794115aef1d7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:15.490428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-251f42bd-750f-41d9-9f1d-794115aef1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:15.505589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f42bd-750f-41d9-9f1d-794115aef1d7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:15.512014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148414c-a160-491b-b09c-8b76a40e6ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:15.513065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148414c-a160-491b-b09c-8b76a40e6ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:15.514230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148414c-a160-491b-b09c-8b76a40e6ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:15.514756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148414c-a160-491b-b09c-8b76a40e6ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:15.528096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148414c-a160-491b-b09c-8b76a40e6ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:15.530074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148414c-a160-491b-b09c-8b76a40e6ecf service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:15.543157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 943/1913] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:16.053738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.055420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:16.076457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68430a-962e-4a37-9c1d-0a7b22a12bb2 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.085600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.087220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.088007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.088452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] PATH_INFO: `/v3/projects/9727a48a5c1a454fb6f7a985127c6252` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.098215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9727a48a5c1a454fb6f7a985127c6252)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:16.101555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:16.129012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148414c-a160-491b-b09c-8b76a40e6ecf service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.131137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2148414c-a160-491b-b09c-8b76a40e6ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:16.164754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148414c-a160-491b-b09c-8b76a40e6ecf service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.173021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.174270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.174810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.175373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] PATH_INFO: `/v3/projects/fce353189b44403e8566a44db4db2198` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.177999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fce353189b44403e8566a44db4db2198)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:16.182466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:16.201660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9727a48a5c1a454fb6f7a985127c6252', 'request_id': 'req-704fcb12-04d6-4f91-b334-1b31af899446'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.219537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9727a48a5c1a454fb6f7a985127c6252', 'request_id': 'req-704fcb12-04d6-4f91-b334-1b31af899446'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.230645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9727a48a5c1a454fb6f7a985127c6252', 'request_id': 'req-704fcb12-04d6-4f91-b334-1b31af899446'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.246604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] The token cache is being invalidate because project 9727a48a5c1a454fb6f7a985127c6252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:16.247327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.248232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-704fcb12-04d6-4f91-b334-1b31af899446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.251510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 971/1914] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:16 2022] DELETE /identity/v3/projects/9727a48a5c1a454fb6f7a985127c6252 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:16.256404 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fce353189b44403e8566a44db4db2198', 'request_id': 'req-660e36d1-f900-449c-8404-dc79a8536c5c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.256564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101c437-ee5b-462a-b9d5-ad23b7b1dcfa None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.256768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101c437-ee5b-462a-b9d5-ad23b7b1dcfa None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.257082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101c437-ee5b-462a-b9d5-ad23b7b1dcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.264012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fce353189b44403e8566a44db4db2198', 'request_id': 'req-660e36d1-f900-449c-8404-dc79a8536c5c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.280902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2101c437-ee5b-462a-b9d5-ad23b7b1dcfa None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:16.282298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2101c437-ee5b-462a-b9d5-ad23b7b1dcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:16.284524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fce353189b44403e8566a44db4db2198', 'request_id': 'req-660e36d1-f900-449c-8404-dc79a8536c5c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.302957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] The token cache is being invalidate because project fce353189b44403e8566a44db4db2198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:16.303254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.304296 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.308255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 944/1915] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:16 2022] DELETE /identity/v3/projects/fce353189b44403e8566a44db4db2198 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:16.313412 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.316457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:16.355933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 972/1916] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:16.363842 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c376d-466f-4009-af24-627640603b6e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.364169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c376d-466f-4009-af24-627640603b6e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.364495 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c376d-466f-4009-af24-627640603b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.387293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-571c376d-466f-4009-af24-627640603b6e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:16.390675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-571c376d-466f-4009-af24-627640603b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:16.399439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 973/1917] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:16.403801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c376d-466f-4009-af24-627640603b6e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.423836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c376d-466f-4009-af24-627640603b6e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.436592 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4a2f2-0b3e-4702-b108-c1f45cd056b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.439369 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4a2f2-0b3e-4702-b108-c1f45cd056b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.439676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4a2f2-0b3e-4702-b108-c1f45cd056b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.439963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4a2f2-0b3e-4702-b108-c1f45cd056b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.446493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4a2f2-0b3e-4702-b108-c1f45cd056b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:16.447265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4a2f2-0b3e-4702-b108-c1f45cd056b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:16.450503 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4a2f2-0b3e-4702-b108-c1f45cd056b7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:16.469536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e36d1-f900-449c-8404-dc79a8536c5c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.487871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.488399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 974/1918] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:16.488831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.489213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.489510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] PATH_INFO: `/v3/users/78d8917e909743a88bbb7c64ed5891fd` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.491971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d8917e909743a88bbb7c64ed5891fd)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:16.493141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4a2f2-0b3e-4702-b108-c1f45cd056b7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.495199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:16.526983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4a2f2-0b3e-4702-b108-c1f45cd056b7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.538952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61184af-9e8d-4ed3-a954-c460f8eec5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.543713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61184af-9e8d-4ed3-a954-c460f8eec5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.545989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61184af-9e8d-4ed3-a954-c460f8eec5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.546284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61184af-9e8d-4ed3-a954-c460f8eec5e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.547563 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61184af-9e8d-4ed3-a954-c460f8eec5e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:16.549917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61184af-9e8d-4ed3-a954-c460f8eec5e1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:16.607463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d8917e909743a88bbb7c64ed5891fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.609389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d8917e909743a88bbb7c64ed5891fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.610555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d8917e909743a88bbb7c64ed5891fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.612422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:16.613610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 975/1919] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:16 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:16.614695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61184af-9e8d-4ed3-a954-c460f8eec5e1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.616714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a61184af-9e8d-4ed3-a954-c460f8eec5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:16.635760 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:16.638832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d8917e909743a88bbb7c64ed5891fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.648113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d8917e909743a88bbb7c64ed5891fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.665591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 945/1920] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:16 2022] DELETE /identity/v3/users/78d8917e909743a88bbb7c64ed5891fd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:16.666775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.668164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:16.708632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61184af-9e8d-4ed3-a954-c460f8eec5e1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.765740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26910965-d31f-4052-b3f9-d19956bffc8c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.774286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f18595-b365-4185-9d2f-d14ac015589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.775478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f18595-b365-4185-9d2f-d14ac015589f admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.775964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f18595-b365-4185-9d2f-d14ac015589f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.776325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f18595-b365-4185-9d2f-d14ac015589f admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.777145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f18595-b365-4185-9d2f-d14ac015589f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:16.779568 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f18595-b365-4185-9d2f-d14ac015589f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:16.794486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.795695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.796305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.796916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] PATH_INFO: `/v3/projects/d8ba83f6027d47848d3d90b8d4cadb0e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.799093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ba83f6027d47848d3d90b8d4cadb0e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:16.801774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:16.812738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 946/1921] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:16 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:16.816922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f18595-b365-4185-9d2f-d14ac015589f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.831331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f18595-b365-4185-9d2f-d14ac015589f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.842022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02d156-d65d-4368-b910-f588d884e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.842833 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d156-d65d-4368-b910-f588d884e4fa admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.843167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d156-d65d-4368-b910-f588d884e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.843450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02d156-d65d-4368-b910-f588d884e4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.845268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02d156-d65d-4368-b910-f588d884e4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:16.847244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02d156-d65d-4368-b910-f588d884e4fa admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:16.864837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 947/1922] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:16.865846 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02d156-d65d-4368-b910-f588d884e4fa admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.877710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02d156-d65d-4368-b910-f588d884e4fa admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.892197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ba83f6027d47848d3d90b8d4cadb0e', 'request_id': 'req-da9d2efd-4c65-4868-b77f-3dd44376f9fd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.898209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ba83f6027d47848d3d90b8d4cadb0e', 'request_id': 'req-da9d2efd-4c65-4868-b77f-3dd44376f9fd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.907748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ba83f6027d47848d3d90b8d4cadb0e', 'request_id': 'req-da9d2efd-4c65-4868-b77f-3dd44376f9fd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.945027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] The token cache is being invalidate because project d8ba83f6027d47848d3d90b8d4cadb0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:16.945327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.947246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:16.953584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 976/1923] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:16 2022] DELETE /identity/v3/projects/d8ba83f6027d47848d3d90b8d4cadb0e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:16.965306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.967578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:16.967713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14ec1-d028-4224-8c76-51ca1f2392c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.968359 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14ec1-d028-4224-8c76-51ca1f2392c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:16.968651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14ec1-d028-4224-8c76-51ca1f2392c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:16.969045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14ec1-d028-4224-8c76-51ca1f2392c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:16.970116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c14ec1-d028-4224-8c76-51ca1f2392c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:16.971961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c14ec1-d028-4224-8c76-51ca1f2392c8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:16.984375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d2efd-4c65-4868-b77f-3dd44376f9fd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:16.994492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 948/1924] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:16.995469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14ec1-d028-4224-8c76-51ca1f2392c8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:16.997584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:16.998193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0c14ec1-d028-4224-8c76-51ca1f2392c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:16.999646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.000339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.000761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] PATH_INFO: `/v3/users/68b46c8452964d00a1644fafec9f6cd5` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.012702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c14ec1-d028-4224-8c76-51ca1f2392c8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.018214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b46c8452964d00a1644fafec9f6cd5)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.019315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b026c-5a53-47df-9e55-59a0608d838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.020453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b026c-5a53-47df-9e55-59a0608d838a admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.020559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.021079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b026c-5a53-47df-9e55-59a0608d838a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.021550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b026c-5a53-47df-9e55-59a0608d838a admin admin] PATH_INFO: `/v3/projects/f62678822a4b43b4a5760e06e66dfcc7/users/a949172c43724db19c7011d168c4387e/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.050727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b026c-5a53-47df-9e55-59a0608d838a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62678822a4b43b4a5760e06e66dfcc7, user_id=a949172c43724db19c7011d168c4387e, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.055575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224b026c-5a53-47df-9e55-59a0608d838a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.072749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 949/1925] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:16 2022] PUT /identity/v3/projects/f62678822a4b43b4a5760e06e66dfcc7/users/a949172c43724db19c7011d168c4387e/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:17.074556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b026c-5a53-47df-9e55-59a0608d838a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.076313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-224b026c-5a53-47df-9e55-59a0608d838a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:17.083600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:17.087297 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b46c8452964d00a1644fafec9f6cd5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.088951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b46c8452964d00a1644fafec9f6cd5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.103012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b46c8452964d00a1644fafec9f6cd5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.104185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:17.132387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b46c8452964d00a1644fafec9f6cd5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.133242 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d819e723-191a-45cc-9062-29207b48b8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b46c8452964d00a1644fafec9f6cd5'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.153935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 977/1926] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:16 2022] DELETE /identity/v3/users/68b46c8452964d00a1644fafec9f6cd5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:17.155632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59df90-5522-44b3-bdac-1a38fb849cca None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.155922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59df90-5522-44b3-bdac-1a38fb849cca None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.156202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59df90-5522-44b3-bdac-1a38fb849cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.170422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b026c-5a53-47df-9e55-59a0608d838a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.174960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fe59df90-5522-44b3-bdac-1a38fb849cca None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:17.176180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fe59df90-5522-44b3-bdac-1a38fb849cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:17.260709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.261996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.261996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.262345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] PATH_INFO: `/v3/projects/ce97bea515f04ddfb87fd4a762e22d01` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.263639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce97bea515f04ddfb87fd4a762e22d01)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.265116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 978/1927] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:17.266002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.275270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59df90-5522-44b3-bdac-1a38fb849cca None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.277158 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fe59df90-5522-44b3-bdac-1a38fb849cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:17.344421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce97bea515f04ddfb87fd4a762e22d01', 'request_id': 'req-336741fe-2a44-4099-b01c-66a823db1e18'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.353380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce97bea515f04ddfb87fd4a762e22d01', 'request_id': 'req-336741fe-2a44-4099-b01c-66a823db1e18'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.355490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59df90-5522-44b3-bdac-1a38fb849cca None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.364435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce97bea515f04ddfb87fd4a762e22d01', 'request_id': 'req-336741fe-2a44-4099-b01c-66a823db1e18'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.377241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] The token cache is being invalidate because project ce97bea515f04ddfb87fd4a762e22d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:17.377440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.378111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-336741fe-2a44-4099-b01c-66a823db1e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.379739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 950/1928] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:17 2022] DELETE /identity/v3/projects/ce97bea515f04ddfb87fd4a762e22d01 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:17.384537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd9bad-3d9d-4b85-88a8-bf01988b3428 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.384825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd9bad-3d9d-4b85-88a8-bf01988b3428 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.385136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd9bad-3d9d-4b85-88a8-bf01988b3428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.403830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-44dd9bad-3d9d-4b85-88a8-bf01988b3428 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:17.405140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-44dd9bad-3d9d-4b85-88a8-bf01988b3428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:17.417353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7946ab-2596-420d-8af1-7a8c02b189e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.418071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7946ab-2596-420d-8af1-7a8c02b189e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.418427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7946ab-2596-420d-8af1-7a8c02b189e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.418599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7946ab-2596-420d-8af1-7a8c02b189e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.421001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-dc7946ab-2596-420d-8af1-7a8c02b189e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:17.454418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:17.459535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:17.478912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 951/1929] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:17.486510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a459-3d2b-4c14-bcda-36c94a919918 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.486912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a459-3d2b-4c14-bcda-36c94a919918 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.487187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258a459-3d2b-4c14-bcda-36c94a919918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.497603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7946ab-2596-420d-8af1-7a8c02b189e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.499686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7946ab-2596-420d-8af1-7a8c02b189e5 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.520611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2258a459-3d2b-4c14-bcda-36c94a919918 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:17.522096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2258a459-3d2b-4c14-bcda-36c94a919918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:17.525076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 979/1930] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:17.532805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 952/1931] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:17.537439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7946ab-2596-420d-8af1-7a8c02b189e5 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.545639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a459-3d2b-4c14-bcda-36c94a919918 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.547356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2258a459-3d2b-4c14-bcda-36c94a919918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:17.548204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7946ab-2596-420d-8af1-7a8c02b189e5 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.558535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb8b85-9a80-4dd4-a51f-6c6522843d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.559247 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb8b85-9a80-4dd4-a51f-6c6522843d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.559500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb8b85-9a80-4dd4-a51f-6c6522843d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.559779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb8b85-9a80-4dd4-a51f-6c6522843d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.560539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb8b85-9a80-4dd4-a51f-6c6522843d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:17.561212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb8b85-9a80-4dd4-a51f-6c6522843d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.563146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb8b85-9a80-4dd4-a51f-6c6522843d81 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.563934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258a459-3d2b-4c14-bcda-36c94a919918 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.578350 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.579516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 980/1932] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:17.580305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.580800 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.581434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] PATH_INFO: `/v3/projects/af3d6604a01441d698b7a14be20afb6a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.583700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3d6604a01441d698b7a14be20afb6a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.584041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb8b85-9a80-4dd4-a51f-6c6522843d81 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.586548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.597105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb8b85-9a80-4dd4-a51f-6c6522843d81 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.605158 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efefc2-492e-440b-8ccf-fdcdd374aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.605981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efefc2-492e-440b-8ccf-fdcdd374aed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.606868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efefc2-492e-440b-8ccf-fdcdd374aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.607225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efefc2-492e-440b-8ccf-fdcdd374aed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.608232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efefc2-492e-440b-8ccf-fdcdd374aed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.610605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efefc2-492e-440b-8ccf-fdcdd374aed2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.671479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3d6604a01441d698b7a14be20afb6a', 'request_id': 'req-8d2a2074-6b7e-4170-af20-d75e30726b06'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.686717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 981/1933] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:17 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:17.691316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efefc2-492e-440b-8ccf-fdcdd374aed2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.694167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3d6604a01441d698b7a14be20afb6a', 'request_id': 'req-8d2a2074-6b7e-4170-af20-d75e30726b06'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.720887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3d6604a01441d698b7a14be20afb6a', 'request_id': 'req-8d2a2074-6b7e-4170-af20-d75e30726b06'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.779131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efefc2-492e-440b-8ccf-fdcdd374aed2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.784737 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6aea0-edcc-4341-a2ec-3f3cb1b33ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.785461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6aea0-edcc-4341-a2ec-3f3cb1b33ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.785910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6aea0-edcc-4341-a2ec-3f3cb1b33ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.786189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6aea0-edcc-4341-a2ec-3f3cb1b33ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.786268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] The token cache is being invalidate because project af3d6604a01441d698b7a14be20afb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:17.786511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.786928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6aea0-edcc-4341-a2ec-3f3cb1b33ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.788884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6aea0-edcc-4341-a2ec-3f3cb1b33ea1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.794089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:17.800745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 953/1934] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:17 2022] DELETE /identity/v3/projects/af3d6604a01441d698b7a14be20afb6a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:17.805144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.806920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:17.818545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 982/1935] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:17 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:17.819711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6aea0-edcc-4341-a2ec-3f3cb1b33ea1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.822259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-50a6aea0-edcc-4341-a2ec-3f3cb1b33ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:17.838961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6aea0-edcc-4341-a2ec-3f3cb1b33ea1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.847852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba343af8-bb3f-4c0b-9f35-b224ceb1edc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.848595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba343af8-bb3f-4c0b-9f35-b224ceb1edc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.848916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba343af8-bb3f-4c0b-9f35-b224ceb1edc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.849137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba343af8-bb3f-4c0b-9f35-b224ceb1edc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.851079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba343af8-bb3f-4c0b-9f35-b224ceb1edc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.853660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba343af8-bb3f-4c0b-9f35-b224ceb1edc5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.891261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 983/1936] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:17.896821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba343af8-bb3f-4c0b-9f35-b224ceb1edc5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.925332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba343af8-bb3f-4c0b-9f35-b224ceb1edc5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.933580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63d337-a1b4-44d9-ac17-0e53f10fe6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.934822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63d337-a1b4-44d9-ac17-0e53f10fe6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.935227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a2074-6b7e-4170-af20-d75e30726b06 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.935559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63d337-a1b4-44d9-ac17-0e53f10fe6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.936036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63d337-a1b4-44d9-ac17-0e53f10fe6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.937130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63d337-a1b4-44d9-ac17-0e53f10fe6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.939250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63d337-a1b4-44d9-ac17-0e53f10fe6f5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.949812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.950894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.951177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:17.951877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] PATH_INFO: `/v3/users/5b488627446a4b2c9b7f8445e0040030` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:17.953813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 984/1937] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:17.958147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b488627446a4b2c9b7f8445e0040030)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:17.958636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63d337-a1b4-44d9-ac17-0e53f10fe6f5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:17.964558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:17.981407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63d337-a1b4-44d9-ac17-0e53f10fe6f5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:17.998479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be99d-444e-4dcd-b230-79c8130bd3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:17.999506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be99d-444e-4dcd-b230-79c8130bd3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:17.999848 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be99d-444e-4dcd-b230-79c8130bd3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:18.000126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be99d-444e-4dcd-b230-79c8130bd3d2 admin admin] PATH_INFO: `/v3/projects/b24a603aa6b440ad89fd3cd53d6dc69f/users/be24b071d0aa4870bcc44fa272e8e83a/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:18.043660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618be99d-444e-4dcd-b230-79c8130bd3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24a603aa6b440ad89fd3cd53d6dc69f, user_id=be24b071d0aa4870bcc44fa272e8e83a, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:18.046999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618be99d-444e-4dcd-b230-79c8130bd3d2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:18.068250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 985/1938] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:17 2022] PUT /identity/v3/projects/b24a603aa6b440ad89fd3cd53d6dc69f/users/be24b071d0aa4870bcc44fa272e8e83a/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:18.076924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b488627446a4b2c9b7f8445e0040030'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:18.077829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b488627446a4b2c9b7f8445e0040030'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:18.081551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b488627446a4b2c9b7f8445e0040030'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:18.081706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61954ed1-dd72-444a-9320-b033e058fefa None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:18.081706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61954ed1-dd72-444a-9320-b033e058fefa None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:18.081706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61954ed1-dd72-444a-9320-b033e058fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:18.096954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b488627446a4b2c9b7f8445e0040030'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:18.103141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:18.105847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b488627446a4b2c9b7f8445e0040030'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:18.124008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-61954ed1-dd72-444a-9320-b033e058fefa None None] MFA Rules not processed for user `be24b071d0aa4870bcc44fa272e8e83a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:18.126139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-61954ed1-dd72-444a-9320-b033e058fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:18.130485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 954/1939] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:17 2022] DELETE /identity/v3/users/5b488627446a4b2c9b7f8445e0040030 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:18.188511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:18.259064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 986/1940] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:18.263388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:18.265077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:18.387501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e348a72-8905-4274-8227-35ea2fdb7b69 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:18.395326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cce75-9cb1-45d7-a10a-0a9422566227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:18.396177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cce75-9cb1-45d7-a10a-0a9422566227 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:18.396553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cce75-9cb1-45d7-a10a-0a9422566227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:18.396957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849cce75-9cb1-45d7-a10a-0a9422566227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:18.397741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cce75-9cb1-45d7-a10a-0a9422566227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:18.400105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849cce75-9cb1-45d7-a10a-0a9422566227 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:18.447062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 955/1941] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:18 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:18.451052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61954ed1-dd72-444a-9320-b033e058fefa None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:18.668492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61954ed1-dd72-444a-9320-b033e058fefa None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:18.798758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1176e3b-0c8b-4a02-8cb0-abdf0f58a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:18.801731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176e3b-0c8b-4a02-8cb0-abdf0f58a8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:18.802089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176e3b-0c8b-4a02-8cb0-abdf0f58a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:18.802474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1176e3b-0c8b-4a02-8cb0-abdf0f58a8e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:18.804190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176e3b-0c8b-4a02-8cb0-abdf0f58a8e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:18.810242 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1176e3b-0c8b-4a02-8cb0-abdf0f58a8e4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:18.850710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cce75-9cb1-45d7-a10a-0a9422566227 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:18.851996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 987/1942] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:18 2022] POST /identity/v3/users => generated 300 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:18.853989 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-849cce75-9cb1-45d7-a10a-0a9422566227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:18.855632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1176e3b-0c8b-4a02-8cb0-abdf0f58a8e4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:18.871646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1176e3b-0c8b-4a02-8cb0-abdf0f58a8e4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:18.872929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849cce75-9cb1-45d7-a10a-0a9422566227 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:18.880425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:18.881936 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:18.882415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:18.883214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] PATH_INFO: `/v3/projects/b2f7216f4ec64142bdc6c945b0b5af50` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:18.884971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f7216f4ec64142bdc6c945b0b5af50)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:18.887717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:18.888781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5a819-6728-4130-9117-424337a88639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:18.889730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5a819-6728-4130-9117-424337a88639 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:18.890123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5a819-6728-4130-9117-424337a88639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:18.890428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5a819-6728-4130-9117-424337a88639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:18.891231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5a819-6728-4130-9117-424337a88639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:18.893211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5a819-6728-4130-9117-424337a88639 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:18.928626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 988/1943] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:18.933377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5a819-6728-4130-9117-424337a88639 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:18.946151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5a819-6728-4130-9117-424337a88639 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:18.960702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990fec1-c204-4a60-a740-4cd605cae6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:18.961427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990fec1-c204-4a60-a740-4cd605cae6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:18.962691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990fec1-c204-4a60-a740-4cd605cae6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:18.962691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990fec1-c204-4a60-a740-4cd605cae6c6 admin admin] PATH_INFO: `/v3/projects/88792f61ef774b2fbdac49f7a783c557/users/65c54629a84c4b8abe684e80e53497c9/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:18.991311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990fec1-c204-4a60-a740-4cd605cae6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88792f61ef774b2fbdac49f7a783c557, user_id=65c54629a84c4b8abe684e80e53497c9, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.002915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990fec1-c204-4a60-a740-4cd605cae6c6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.030801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 989/1944] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:18 2022] PUT /identity/v3/projects/88792f61ef774b2fbdac49f7a783c557/users/65c54629a84c4b8abe684e80e53497c9/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:19.033740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd40b2-94c8-4a5f-84bd-ad83e0134f9a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.034073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd40b2-94c8-4a5f-84bd-ad83e0134f9a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.034437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd40b2-94c8-4a5f-84bd-ad83e0134f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.074949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f7216f4ec64142bdc6c945b0b5af50', 'request_id': 'req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:19.101834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-50bd40b2-94c8-4a5f-84bd-ad83e0134f9a None None] MFA Rules not processed for user `a949172c43724db19c7011d168c4387e`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:19.103776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f7216f4ec64142bdc6c945b0b5af50', 'request_id': 'req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:19.104315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-50bd40b2-94c8-4a5f-84bd-ad83e0134f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:19.124286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:19.125399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f7216f4ec64142bdc6c945b0b5af50', 'request_id': 'req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:19.140518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] The token cache is being invalidate because project b2f7216f4ec64142bdc6c945b0b5af50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:19.140810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:19.141521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:19.143407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 956/1945] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:18 2022] DELETE /identity/v3/projects/b2f7216f4ec64142bdc6c945b0b5af50 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:19.144762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.149507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:19.242151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 990/1946] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:19.242151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2333-f140-44b3-b347-b9f40eb3688e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.242151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2333-f140-44b3-b347-b9f40eb3688e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.242151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d2333-f140-44b3-b347-b9f40eb3688e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.261198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c34d2333-f140-44b3-b347-b9f40eb3688e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:19.262459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c34d2333-f140-44b3-b347-b9f40eb3688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:19.280453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:19.288201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bbaba-5bd8-4a3b-8b73-e925c0e898f4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.333787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 991/1947] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:19.334777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2333-f140-44b3-b347-b9f40eb3688e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.336156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c34d2333-f140-44b3-b347-b9f40eb3688e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:19.351493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d2333-f140-44b3-b347-b9f40eb3688e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.357391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ae246-5a31-4fac-ba2d-2b288bd5f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.358363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ae246-5a31-4fac-ba2d-2b288bd5f7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.358654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ae246-5a31-4fac-ba2d-2b288bd5f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.358933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ae246-5a31-4fac-ba2d-2b288bd5f7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.359637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ae246-5a31-4fac-ba2d-2b288bd5f7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.366069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ae246-5a31-4fac-ba2d-2b288bd5f7c9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.375116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ab6a8-880c-40de-86f4-b3713359664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.376105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab6a8-880c-40de-86f4-b3713359664a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.376605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab6a8-880c-40de-86f4-b3713359664a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.377110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab6a8-880c-40de-86f4-b3713359664a admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.378197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ab6a8-880c-40de-86f4-b3713359664a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.380138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ab6a8-880c-40de-86f4-b3713359664a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.391612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 957/1948] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:19.393179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd60e77-bad0-4577-baf3-12625c26f13a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.393464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd60e77-bad0-4577-baf3-12625c26f13a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.393735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd60e77-bad0-4577-baf3-12625c26f13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.401703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 992/1949] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:19 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:19.402181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ae246-5a31-4fac-ba2d-2b288bd5f7c9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.411826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fdd60e77-bad0-4577-baf3-12625c26f13a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:19.413191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fdd60e77-bad0-4577-baf3-12625c26f13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:19.462692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ae246-5a31-4fac-ba2d-2b288bd5f7c9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.468110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6491f3c-3dc2-471f-9a1c-74e29e9e1057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.469088 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6491f3c-3dc2-471f-9a1c-74e29e9e1057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.469536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6491f3c-3dc2-471f-9a1c-74e29e9e1057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.470166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6491f3c-3dc2-471f-9a1c-74e29e9e1057 admin admin] PATH_INFO: `/v3/projects/88792f61ef774b2fbdac49f7a783c557/users/65c54629a84c4b8abe684e80e53497c9/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.472165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6491f3c-3dc2-471f-9a1c-74e29e9e1057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88792f61ef774b2fbdac49f7a783c557, user_id=65c54629a84c4b8abe684e80e53497c9, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.474900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6491f3c-3dc2-471f-9a1c-74e29e9e1057 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.476763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 958/1950] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:19.477704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd60e77-bad0-4577-baf3-12625c26f13a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.485496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 993/1951] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:19 2022] PUT /identity/v3/projects/88792f61ef774b2fbdac49f7a783c557/users/65c54629a84c4b8abe684e80e53497c9/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:19.486302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6491f3c-3dc2-471f-9a1c-74e29e9e1057 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.486995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd60e77-bad0-4577-baf3-12625c26f13a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.519659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:19.567938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6491f3c-3dc2-471f-9a1c-74e29e9e1057 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.573216 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bc6f4-7dee-4907-9f6d-8373163d756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.574017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a8c2-3fa6-4357-88a5-0aa1321a9dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.574257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bc6f4-7dee-4907-9f6d-8373163d756d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.574602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bc6f4-7dee-4907-9f6d-8373163d756d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.574905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a8c2-3fa6-4357-88a5-0aa1321a9dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.575023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bc6f4-7dee-4907-9f6d-8373163d756d admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.575220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a8c2-3fa6-4357-88a5-0aa1321a9dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.575492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a8c2-3fa6-4357-88a5-0aa1321a9dd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.575767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bc6f4-7dee-4907-9f6d-8373163d756d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.576278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863a8c2-3fa6-4357-88a5-0aa1321a9dd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:19.576587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863a8c2-3fa6-4357-88a5-0aa1321a9dd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.577922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bc6f4-7dee-4907-9f6d-8373163d756d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.578643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f863a8c2-3fa6-4357-88a5-0aa1321a9dd7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.592415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 994/1952] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:19.593779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073f9de-bc38-4f13-a4d4-06241af3aff9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.594067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073f9de-bc38-4f13-a4d4-06241af3aff9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.594475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073f9de-bc38-4f13-a4d4-06241af3aff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.600749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 959/1953] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:19 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:19.601782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bc6f4-7dee-4907-9f6d-8373163d756d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.617362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bc6f4-7dee-4907-9f6d-8373163d756d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.623978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a9a71-92f8-40ad-9061-ff62e461b2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.624780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a9a71-92f8-40ad-9061-ff62e461b2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.625110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a9a71-92f8-40ad-9061-ff62e461b2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.625581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a9a71-92f8-40ad-9061-ff62e461b2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.626376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a9a71-92f8-40ad-9061-ff62e461b2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.627973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2073f9de-bc38-4f13-a4d4-06241af3aff9 None None] MFA Rules not processed for user `65c54629a84c4b8abe684e80e53497c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:19.628583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a9a71-92f8-40ad-9061-ff62e461b2b4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.630057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2073f9de-bc38-4f13-a4d4-06241af3aff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:19.664269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 960/1954] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:19 2022] POST /identity/v3/projects => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:19.665454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a9a71-92f8-40ad-9061-ff62e461b2b4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.681403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:19.715744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 995/1955] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:19.716792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073f9de-bc38-4f13-a4d4-06241af3aff9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.731717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073f9de-bc38-4f13-a4d4-06241af3aff9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.774159 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a9a71-92f8-40ad-9061-ff62e461b2b4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.779368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a3e95-0714-433f-931d-b9428316a019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.780174 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a3e95-0714-433f-931d-b9428316a019 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.780409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a3e95-0714-433f-931d-b9428316a019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.780684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a3e95-0714-433f-931d-b9428316a019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.781466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a3e95-0714-433f-931d-b9428316a019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.783111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a3e95-0714-433f-931d-b9428316a019 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.797036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 961/1956] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:19.797036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a3e95-0714-433f-931d-b9428316a019 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.797036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2b3a3e95-0714-433f-931d-b9428316a019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:19.825674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29ec05-49e8-4f5f-8725-f091daabc55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.835966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29ec05-49e8-4f5f-8725-f091daabc55d admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.837223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29ec05-49e8-4f5f-8725-f091daabc55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.837505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29ec05-49e8-4f5f-8725-f091daabc55d admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.838414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29ec05-49e8-4f5f-8725-f091daabc55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.841221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29ec05-49e8-4f5f-8725-f091daabc55d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.870688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 996/1957] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:19 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:19.871809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29ec05-49e8-4f5f-8725-f091daabc55d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.873746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a3e95-0714-433f-931d-b9428316a019 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.879261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf00d9-3248-4e14-a5a9-fd83afb51519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.881639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf00d9-3248-4e14-a5a9-fd83afb51519 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.881913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf00d9-3248-4e14-a5a9-fd83afb51519 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.882182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf00d9-3248-4e14-a5a9-fd83afb51519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.893753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29ec05-49e8-4f5f-8725-f091daabc55d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:19.899633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728d481-eb17-44b2-be20-8654177e12fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:19.901065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728d481-eb17-44b2-be20-8654177e12fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:19.901502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728d481-eb17-44b2-be20-8654177e12fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:19.901886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728d481-eb17-44b2-be20-8654177e12fd admin admin] PATH_INFO: `/v3/projects/ae188b49bad448f2abeec557f80f0738/users/cab9b0e109af430d8e2be3ce219a673b/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:19.923391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728d481-eb17-44b2-be20-8654177e12fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae188b49bad448f2abeec557f80f0738, user_id=cab9b0e109af430d8e2be3ce219a673b, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.928733 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728d481-eb17-44b2-be20-8654177e12fd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.948031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf00d9-3248-4e14-a5a9-fd83afb51519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:19.949916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf00d9-3248-4e14-a5a9-fd83afb51519 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:19.950066 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 997/1958] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:19 2022] PUT /identity/v3/projects/ae188b49bad448f2abeec557f80f0738/users/cab9b0e109af430d8e2be3ce219a673b/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:19.950635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728d481-eb17-44b2-be20-8654177e12fd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.963339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 962/1959] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:19.964363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf00d9-3248-4e14-a5a9-fd83afb51519 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:19.974121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:19.978031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf00d9-3248-4e14-a5a9-fd83afb51519 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:20.051659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:20.060284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728d481-eb17-44b2-be20-8654177e12fd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:20.067236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da0975-9dad-464f-84c1-adaedc38da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:20.068596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da0975-9dad-464f-84c1-adaedc38da14 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:20.069405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da0975-9dad-464f-84c1-adaedc38da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:20.070003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da0975-9dad-464f-84c1-adaedc38da14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:20.070869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da0975-9dad-464f-84c1-adaedc38da14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:20.072770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da0975-9dad-464f-84c1-adaedc38da14 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:20.076934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e0790-7d99-4ce4-9516-706f1b9999d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:20.076934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e0790-7d99-4ce4-9516-706f1b9999d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:20.079700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e0790-7d99-4ce4-9516-706f1b9999d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:20.079700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e0790-7d99-4ce4-9516-706f1b9999d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:20.080449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e0790-7d99-4ce4-9516-706f1b9999d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:20.085312 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e0790-7d99-4ce4-9516-706f1b9999d6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:20.087862 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 998/1960] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:20.092212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da0975-9dad-464f-84c1-adaedc38da14 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:20.104752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da0975-9dad-464f-84c1-adaedc38da14 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:20.106844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 963/1961] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:20.111707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50360a1-f3f8-410c-87da-89c884812df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:20.112469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50360a1-f3f8-410c-87da-89c884812df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:20.112891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50360a1-f3f8-410c-87da-89c884812df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:20.113520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50360a1-f3f8-410c-87da-89c884812df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:20.114279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50360a1-f3f8-410c-87da-89c884812df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:20.116232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50360a1-f3f8-410c-87da-89c884812df9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:20.118120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e0790-7d99-4ce4-9516-706f1b9999d6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:20.131135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 999/1962] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:20.132695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e0790-7d99-4ce4-9516-706f1b9999d6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:20.135294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50360a1-f3f8-410c-87da-89c884812df9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:20.138067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d416f701-50e5-46da-b4bf-1a2c7b5aedce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:20.139359 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f701-50e5-46da-b4bf-1a2c7b5aedce admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:20.139646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f701-50e5-46da-b4bf-1a2c7b5aedce admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:20.140070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d416f701-50e5-46da-b4bf-1a2c7b5aedce admin admin] PATH_INFO: `/v3/projects/ae188b49bad448f2abeec557f80f0738/users/cab9b0e109af430d8e2be3ce219a673b/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:20.142293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416f701-50e5-46da-b4bf-1a2c7b5aedce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae188b49bad448f2abeec557f80f0738, user_id=cab9b0e109af430d8e2be3ce219a673b, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:20.146311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d416f701-50e5-46da-b4bf-1a2c7b5aedce admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:20.151782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50360a1-f3f8-410c-87da-89c884812df9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:20.160711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 964/1963] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:20 2022] PUT /identity/v3/projects/ae188b49bad448f2abeec557f80f0738/users/cab9b0e109af430d8e2be3ce219a673b/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:20.277671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c1317-ae5e-433c-bf28-71e93ef69cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:20.278660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c1317-ae5e-433c-bf28-71e93ef69cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:20.278874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c1317-ae5e-433c-bf28-71e93ef69cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:20.279245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c1317-ae5e-433c-bf28-71e93ef69cfc admin admin] PATH_INFO: `/v3/projects/157de3457f8549eea2c6d39586917818/users/ebf17f9b448b4a7cbcc2119c0b36e918/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:20.324018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c1317-ae5e-433c-bf28-71e93ef69cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=157de3457f8549eea2c6d39586917818, user_id=ebf17f9b448b4a7cbcc2119c0b36e918, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:20.332600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c1317-ae5e-433c-bf28-71e93ef69cfc admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:20.368893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1000/1964] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:20 2022] PUT /identity/v3/projects/157de3457f8549eea2c6d39586917818/users/ebf17f9b448b4a7cbcc2119c0b36e918/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:20.379446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf184-9292-4a08-b2f5-fc04cc34ffe2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:20.380000 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf184-9292-4a08-b2f5-fc04cc34ffe2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:20.380083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf184-9292-4a08-b2f5-fc04cc34ffe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:20.463079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f9dcf184-9292-4a08-b2f5-fc04cc34ffe2 None None] MFA Rules not processed for user `ebf17f9b448b4a7cbcc2119c0b36e918`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:20.464422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f9dcf184-9292-4a08-b2f5-fc04cc34ffe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:20.625845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 965/1965] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:20.634206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c1317-ae5e-433c-bf28-71e93ef69cfc admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:20.780308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c1317-ae5e-433c-bf28-71e93ef69cfc admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:20.787071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681dc17-56f1-4590-9f53-4f88967df769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:20.787823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681dc17-56f1-4590-9f53-4f88967df769 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:20.788107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681dc17-56f1-4590-9f53-4f88967df769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:20.788381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681dc17-56f1-4590-9f53-4f88967df769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:20.789285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681dc17-56f1-4590-9f53-4f88967df769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:20.791685 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681dc17-56f1-4590-9f53-4f88967df769 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:20.837395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1001/1966] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:20 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:20.841285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf184-9292-4a08-b2f5-fc04cc34ffe2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:20.863771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcf184-9292-4a08-b2f5-fc04cc34ffe2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:20.903564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681dc17-56f1-4590-9f53-4f88967df769 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:20.917856 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:20.991157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa640bac-d3e7-44f7-97a5-71dd0041f702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:20.993132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa640bac-d3e7-44f7-97a5-71dd0041f702 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:20.993597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa640bac-d3e7-44f7-97a5-71dd0041f702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:20.994090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa640bac-d3e7-44f7-97a5-71dd0041f702 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:20.995024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa640bac-d3e7-44f7-97a5-71dd0041f702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:20.998169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa640bac-d3e7-44f7-97a5-71dd0041f702 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:21.044799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 966/1967] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:20 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:21.049850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa640bac-d3e7-44f7-97a5-71dd0041f702 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:21.066396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa640bac-d3e7-44f7-97a5-71dd0041f702 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:21.071445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761bc9d-c654-404f-b085-509918f456f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:21.072442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761bc9d-c654-404f-b085-509918f456f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.072764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761bc9d-c654-404f-b085-509918f456f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.073144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761bc9d-c654-404f-b085-509918f456f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.076966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761bc9d-c654-404f-b085-509918f456f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:21.090826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761bc9d-c654-404f-b085-509918f456f2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:21.095185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681dc17-56f1-4590-9f53-4f88967df769 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:21.110549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:21.112354 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.113577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.114551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] PATH_INFO: `/v3/users/be24b071d0aa4870bcc44fa272e8e83a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.114661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 967/1968] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:21.116488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be24b071d0aa4870bcc44fa272e8e83a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:21.119958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:21.120701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761bc9d-c654-404f-b085-509918f456f2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:21.134403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761bc9d-c654-404f-b085-509918f456f2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:21.146746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d0d45-7cb6-4116-8813-5764b174afe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:21.147673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d0d45-7cb6-4116-8813-5764b174afe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.147957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d0d45-7cb6-4116-8813-5764b174afe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.150421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d0d45-7cb6-4116-8813-5764b174afe0 admin admin] PATH_INFO: `/v3/projects/2f46e2cc13904a8889e5831e2d7739a0/users/956115851d754f19aec926b760083aa0/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.174213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d0d45-7cb6-4116-8813-5764b174afe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f46e2cc13904a8889e5831e2d7739a0, user_id=956115851d754f19aec926b760083aa0, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:21.177761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d0d45-7cb6-4116-8813-5764b174afe0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:21.204626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 968/1969] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:21 2022] PUT /identity/v3/projects/2f46e2cc13904a8889e5831e2d7739a0/users/956115851d754f19aec926b760083aa0/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:21.207339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be24b071d0aa4870bcc44fa272e8e83a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:21.209007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d0d45-7cb6-4116-8813-5764b174afe0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:21.209285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be24b071d0aa4870bcc44fa272e8e83a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:21.210836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7b3d0d45-7cb6-4116-8813-5764b174afe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:21.222484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be24b071d0aa4870bcc44fa272e8e83a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:21.235325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be24b071d0aa4870bcc44fa272e8e83a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:21.236099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99af280c-2258-4141-9189-5071184939f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be24b071d0aa4870bcc44fa272e8e83a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:21.245001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:21.273655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1002/1970] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:20 2022] DELETE /identity/v3/users/be24b071d0aa4870bcc44fa272e8e83a => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:21.278589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278b6f-03a8-464e-99a3-2b89b90b583b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.279187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278b6f-03a8-464e-99a3-2b89b90b583b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.279627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278b6f-03a8-464e-99a3-2b89b90b583b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.302424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d4278b6f-03a8-464e-99a3-2b89b90b583b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:21.303841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d4278b6f-03a8-464e-99a3-2b89b90b583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:21.306588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d0d45-7cb6-4116-8813-5764b174afe0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:21.392071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1003/1971] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:21.402978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4278b6f-03a8-464e-99a3-2b89b90b583b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:21.406443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d4278b6f-03a8-464e-99a3-2b89b90b583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:21.406574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ebdee-7cf7-4a15-ab84-092df35fb8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:21.407203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ebdee-7cf7-4a15-ab84-092df35fb8ac admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.407442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ebdee-7cf7-4a15-ab84-092df35fb8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.411198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ebdee-7cf7-4a15-ab84-092df35fb8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.412131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ebdee-7cf7-4a15-ab84-092df35fb8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:21.424547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ebdee-7cf7-4a15-ab84-092df35fb8ac admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:21.426285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 969/1972] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:21.429950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ebdee-7cf7-4a15-ab84-092df35fb8ac admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:21.443804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ebdee-7cf7-4a15-ab84-092df35fb8ac admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:21.449387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5723a98-2bac-4ed7-9a16-6bd230477377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:21.450302 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723a98-2bac-4ed7-9a16-6bd230477377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.450585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723a98-2bac-4ed7-9a16-6bd230477377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.452026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5723a98-2bac-4ed7-9a16-6bd230477377 admin admin] PATH_INFO: `/v3/projects/2f46e2cc13904a8889e5831e2d7739a0/users/956115851d754f19aec926b760083aa0/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.454164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5723a98-2bac-4ed7-9a16-6bd230477377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f46e2cc13904a8889e5831e2d7739a0, user_id=956115851d754f19aec926b760083aa0, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:21.457019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5723a98-2bac-4ed7-9a16-6bd230477377 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:21.478820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:21.508675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 970/1973] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:21 2022] PUT /identity/v3/projects/2f46e2cc13904a8889e5831e2d7739a0/users/956115851d754f19aec926b760083aa0/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:21.510507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb7d0f-7f03-4d3d-8992-4859a4d1f063 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.510793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb7d0f-7f03-4d3d-8992-4859a4d1f063 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.511074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb7d0f-7f03-4d3d-8992-4859a4d1f063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.537914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4278b6f-03a8-464e-99a3-2b89b90b583b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:21.557740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-85bb7d0f-7f03-4d3d-8992-4859a4d1f063 None None] MFA Rules not processed for user `956115851d754f19aec926b760083aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:21.559414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-85bb7d0f-7f03-4d3d-8992-4859a4d1f063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:21.634304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a261745-c3f8-42ba-8ea2-62e4e4565191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:21.635895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a261745-c3f8-42ba-8ea2-62e4e4565191 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.636519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a261745-c3f8-42ba-8ea2-62e4e4565191 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.636916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a261745-c3f8-42ba-8ea2-62e4e4565191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.794666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a261745-c3f8-42ba-8ea2-62e4e4565191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:21.797473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a261745-c3f8-42ba-8ea2-62e4e4565191 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:21.809523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 971/1974] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:21.811206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcf24c-deed-4aba-bfdc-14f620e20609 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.812050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcf24c-deed-4aba-bfdc-14f620e20609 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.812351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcf24c-deed-4aba-bfdc-14f620e20609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.829180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1004/1975] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:21.830007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a261745-c3f8-42ba-8ea2-62e4e4565191 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:21.835815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5a261745-c3f8-42ba-8ea2-62e4e4565191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:21.875023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-96bcf24c-deed-4aba-bfdc-14f620e20609 None None] MFA Rules not processed for user `cab9b0e109af430d8e2be3ce219a673b`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:21.876299 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-96bcf24c-deed-4aba-bfdc-14f620e20609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:21.931264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a261745-c3f8-42ba-8ea2-62e4e4565191 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:21.938419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508af0e-9d1b-4936-a2f3-7c7426fa1032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:21.939217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:21.939356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508af0e-9d1b-4936-a2f3-7c7426fa1032 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:21.940305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508af0e-9d1b-4936-a2f3-7c7426fa1032 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:21.940586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508af0e-9d1b-4936-a2f3-7c7426fa1032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:21.954076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508af0e-9d1b-4936-a2f3-7c7426fa1032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:21.956068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508af0e-9d1b-4936-a2f3-7c7426fa1032 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:21.970479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1005/1976] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:22.016390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 972/1977] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:22.028608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bcca8-69aa-4abd-b692-92d8c854f1dd None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:22.029102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bcca8-69aa-4abd-b692-92d8c854f1dd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:22.029390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bcca8-69aa-4abd-b692-92d8c854f1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:22.049902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-098bcca8-69aa-4abd-b692-92d8c854f1dd None None] MFA Rules not processed for user `a949172c43724db19c7011d168c4387e`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:22.051126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-098bcca8-69aa-4abd-b692-92d8c854f1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:22.088227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:22.136890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1006/1978] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:22.148269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcf24c-deed-4aba-bfdc-14f620e20609 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:22.150065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-96bcf24c-deed-4aba-bfdc-14f620e20609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:22.256176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcf24c-deed-4aba-bfdc-14f620e20609 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:22.264606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ac809-d26f-465b-b7eb-6d80fa8b9395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:22.265383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ac809-d26f-465b-b7eb-6d80fa8b9395 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:22.265737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ac809-d26f-465b-b7eb-6d80fa8b9395 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:22.266078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9ac809-d26f-465b-b7eb-6d80fa8b9395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:22.268584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8f9ac809-d26f-465b-b7eb-6d80fa8b9395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:22.279933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ac809-d26f-465b-b7eb-6d80fa8b9395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:22.281989 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9ac809-d26f-465b-b7eb-6d80fa8b9395 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:22.296809 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 973/1979] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:22.378263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bcca8-69aa-4abd-b692-92d8c854f1dd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:22.381163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-098bcca8-69aa-4abd-b692-92d8c854f1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:22.395933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bcca8-69aa-4abd-b692-92d8c854f1dd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:22.401074 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:22.401965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:22.402246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:22.402520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] PATH_INFO: `/v3/projects/b24a603aa6b440ad89fd3cd53d6dc69f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:22.403855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24a603aa6b440ad89fd3cd53d6dc69f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:22.406252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:22.481048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24a603aa6b440ad89fd3cd53d6dc69f', 'request_id': 'req-9b2cd54d-21b9-4987-9c0b-39968a351089'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.487729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24a603aa6b440ad89fd3cd53d6dc69f', 'request_id': 'req-9b2cd54d-21b9-4987-9c0b-39968a351089'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.498102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24a603aa6b440ad89fd3cd53d6dc69f', 'request_id': 'req-9b2cd54d-21b9-4987-9c0b-39968a351089'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.511697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] The token cache is being invalidate because project b24a603aa6b440ad89fd3cd53d6dc69f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:22.511995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.512667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.514708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1007/1980] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:22 2022] DELETE /identity/v3/projects/b24a603aa6b440ad89fd3cd53d6dc69f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:22.515604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ac809-d26f-465b-b7eb-6d80fa8b9395 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:22.518485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:22.519864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:22.532917 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9ac809-d26f-465b-b7eb-6d80fa8b9395 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:22.596354 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cd54d-21b9-4987-9c0b-39968a351089 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:22.615629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:22.616689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:22.617059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:22.617441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] PATH_INFO: `/v3/users/65c54629a84c4b8abe684e80e53497c9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:22.618793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c54629a84c4b8abe684e80e53497c9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:22.622388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:22.649540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:22.650564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:22.650734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:22.651017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] PATH_INFO: `/v3/users/ebf17f9b448b4a7cbcc2119c0b36e918` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:22.654697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf17f9b448b4a7cbcc2119c0b36e918)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:22.656586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:22.703753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c54629a84c4b8abe684e80e53497c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.706031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c54629a84c4b8abe684e80e53497c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.720932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c54629a84c4b8abe684e80e53497c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.733606 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c54629a84c4b8abe684e80e53497c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.734566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e0fbdad6-dd41-4217-b0dd-47646e715384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c54629a84c4b8abe684e80e53497c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.741735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:22.764784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf17f9b448b4a7cbcc2119c0b36e918'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.765676 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf17f9b448b4a7cbcc2119c0b36e918'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.766754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf17f9b448b4a7cbcc2119c0b36e918'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.772258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:22.791117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf17f9b448b4a7cbcc2119c0b36e918'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.794861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1008/1981] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:22 2022] DELETE /identity/v3/users/65c54629a84c4b8abe684e80e53497c9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:22.806770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf17f9b448b4a7cbcc2119c0b36e918'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:22.833962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 974/1982] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:22 2022] DELETE /identity/v3/users/ebf17f9b448b4a7cbcc2119c0b36e918 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:22.834757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c90a5-d203-47d6-a49c-cf3d73f22753 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:22.835481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c90a5-d203-47d6-a49c-cf3d73f22753 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:22.835963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c90a5-d203-47d6-a49c-cf3d73f22753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:22.863401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6a9c90a5-d203-47d6-a49c-cf3d73f22753 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:22.864915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6a9c90a5-d203-47d6-a49c-cf3d73f22753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:22.943933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1009/1983] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:22.954090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:22.960501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:23.053027 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bd0f7-faad-4d87-b908-da018d955291 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:23.058914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477e6df-dabc-42e2-ad31-288dd75ca604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:23.060096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477e6df-dabc-42e2-ad31-288dd75ca604 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:23.060480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477e6df-dabc-42e2-ad31-288dd75ca604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:23.061108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477e6df-dabc-42e2-ad31-288dd75ca604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:23.085329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477e6df-dabc-42e2-ad31-288dd75ca604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:23.086750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f477e6df-dabc-42e2-ad31-288dd75ca604 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:23.098341 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 975/1984] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:31:23.458479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c90a5-d203-47d6-a49c-cf3d73f22753 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:23.460416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6a9c90a5-d203-47d6-a49c-cf3d73f22753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:23.476947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c90a5-d203-47d6-a49c-cf3d73f22753 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:23.484529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:23.485755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:23.486267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:23.486851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] PATH_INFO: `/v3/projects/88792f61ef774b2fbdac49f7a783c557` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:23.488337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88792f61ef774b2fbdac49f7a783c557)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:23.491189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:23.575352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88792f61ef774b2fbdac49f7a783c557', 'request_id': 'req-bf562906-6eb6-480a-83f7-9f61fac0af5e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:23.583877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88792f61ef774b2fbdac49f7a783c557', 'request_id': 'req-bf562906-6eb6-480a-83f7-9f61fac0af5e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:23.597375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88792f61ef774b2fbdac49f7a783c557', 'request_id': 'req-bf562906-6eb6-480a-83f7-9f61fac0af5e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:23.613957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] The token cache is being invalidate because project 88792f61ef774b2fbdac49f7a783c557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:23.614343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:23.617365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bf562906-6eb6-480a-83f7-9f61fac0af5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:23.619479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1010/1985] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:23 2022] DELETE /identity/v3/projects/88792f61ef774b2fbdac49f7a783c557 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:23.624816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc1338-5b51-41aa-b94b-34f665e7fb3f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:23.625799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc1338-5b51-41aa-b94b-34f665e7fb3f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:23.626084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc1338-5b51-41aa-b94b-34f665e7fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:23.646055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c8bc1338-5b51-41aa-b94b-34f665e7fb3f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:23.647358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c8bc1338-5b51-41aa-b94b-34f665e7fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:23.708487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 976/1986] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:23.716422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d534337-5274-435c-ad10-c71b4838022d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:23.716673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d534337-5274-435c-ad10-c71b4838022d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:23.717016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d534337-5274-435c-ad10-c71b4838022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:23.738979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3d534337-5274-435c-ad10-c71b4838022d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:23.738979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3d534337-5274-435c-ad10-c71b4838022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:23.751805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1011/1987] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:23.755189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc1338-5b51-41aa-b94b-34f665e7fb3f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:23.765306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc1338-5b51-41aa-b94b-34f665e7fb3f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:23.770808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc085-6719-42cf-ba70-ffb7c8addf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:23.771481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc085-6719-42cf-ba70-ffb7c8addf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:23.771765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc085-6719-42cf-ba70-ffb7c8addf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:23.772040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fc085-6719-42cf-ba70-ffb7c8addf14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:23.772783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc085-6719-42cf-ba70-ffb7c8addf14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:23.773156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc085-6719-42cf-ba70-ffb7c8addf14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:23.774773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fc085-6719-42cf-ba70-ffb7c8addf14 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:23.790931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 977/1988] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:23.792278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d534337-5274-435c-ad10-c71b4838022d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:23.801983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d534337-5274-435c-ad10-c71b4838022d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:23.807674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e4287-82aa-4837-8ff4-65322b4ab74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:23.808341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e4287-82aa-4837-8ff4-65322b4ab74c admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:23.808621 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e4287-82aa-4837-8ff4-65322b4ab74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:23.808923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e4287-82aa-4837-8ff4-65322b4ab74c admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:23.809616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e4287-82aa-4837-8ff4-65322b4ab74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:23.811544 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e4287-82aa-4837-8ff4-65322b4ab74c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:23.842537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1012/1989] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:23 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:23.843770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc085-6719-42cf-ba70-ffb7c8addf14 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:23.854881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fc085-6719-42cf-ba70-ffb7c8addf14 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:23.920556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e4287-82aa-4837-8ff4-65322b4ab74c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:23.922787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-012e4287-82aa-4837-8ff4-65322b4ab74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:23.927657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:23.935172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71223629-c3a3-4468-a3e0-10c5180782c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:23.936194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71223629-c3a3-4468-a3e0-10c5180782c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:23.936491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71223629-c3a3-4468-a3e0-10c5180782c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:23.937039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71223629-c3a3-4468-a3e0-10c5180782c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:23.937753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71223629-c3a3-4468-a3e0-10c5180782c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:23.939861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71223629-c3a3-4468-a3e0-10c5180782c0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:23.974769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:23.978232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 978/1990] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:23 2022] POST /identity/v3/users => generated 280 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:23.978232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71223629-c3a3-4468-a3e0-10c5180782c0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:23.979720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-71223629-c3a3-4468-a3e0-10c5180782c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:23.995582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71223629-c3a3-4468-a3e0-10c5180782c0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:24.001036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:24.001233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e4287-82aa-4837-8ff4-65322b4ab74c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:24.002385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.002664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.002935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] PATH_INFO: `/v3/projects/157de3457f8549eea2c6d39586917818` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.004129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157de3457f8549eea2c6d39586917818)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:24.006124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:24.008078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:24.009069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.017795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.017795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] PATH_INFO: `/v3/users/f2461084b85c473c86d9dac824d831c0` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.019109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2461084b85c473c86d9dac824d831c0)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:24.021373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:24.118694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157de3457f8549eea2c6d39586917818', 'request_id': 'req-605f0d86-b90e-4a96-aff4-ed84b16192a7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.126169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157de3457f8549eea2c6d39586917818', 'request_id': 'req-605f0d86-b90e-4a96-aff4-ed84b16192a7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.139618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157de3457f8549eea2c6d39586917818', 'request_id': 'req-605f0d86-b90e-4a96-aff4-ed84b16192a7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.144336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2461084b85c473c86d9dac824d831c0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.149681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2461084b85c473c86d9dac824d831c0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.160344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] The token cache is being invalidate because project 157de3457f8549eea2c6d39586917818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:24.160670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.161661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.161905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2461084b85c473c86d9dac824d831c0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.163272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 979/1991] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:23 2022] DELETE /identity/v3/projects/157de3457f8549eea2c6d39586917818 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:24.166113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:24.166113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:24.171441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2461084b85c473c86d9dac824d831c0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.172145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2461084b85c473c86d9dac824d831c0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.200451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1013/1992] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:23 2022] DELETE /identity/v3/users/f2461084b85c473c86d9dac824d831c0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:24.200451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:24.200451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:24.240242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f0d86-b90e-4a96-aff4-ed84b16192a7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:24.282336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2f192-2691-4ca8-b331-02481d139fd6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:24.289101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:24.290001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.290284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.290603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] PATH_INFO: `/v3/users/956115851d754f19aec926b760083aa0` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.291887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] RBAC: Authorizing `identity:delete_user(user_id=956115851d754f19aec926b760083aa0)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:24.294752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:24.325999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b680d-9e54-48fa-9a2d-b8f205311e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:24.326888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b680d-9e54-48fa-9a2d-b8f205311e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.327134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b680d-9e54-48fa-9a2d-b8f205311e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.327415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b680d-9e54-48fa-9a2d-b8f205311e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.328201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b680d-9e54-48fa-9a2d-b8f205311e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:24.330080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b680d-9e54-48fa-9a2d-b8f205311e39 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:24.341798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 980/1993] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:24.346841 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bcfb-d802-43ea-ab62-934a50d4c273 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.347176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bcfb-d802-43ea-ab62-934a50d4c273 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.347410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bcfb-d802-43ea-ab62-934a50d4c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.369931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-99c9bcfb-d802-43ea-ab62-934a50d4c273 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:24.371165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-99c9bcfb-d802-43ea-ab62-934a50d4c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:24.372433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956115851d754f19aec926b760083aa0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.373516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956115851d754f19aec926b760083aa0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.379789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 981/1994] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:24.380687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bcfb-d802-43ea-ab62-934a50d4c273 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:24.382121 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-99c9bcfb-d802-43ea-ab62-934a50d4c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:24.395966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bcfb-d802-43ea-ab62-934a50d4c273 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:24.396522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956115851d754f19aec926b760083aa0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.401957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f69ef5-ae50-4868-956c-e6c6e671a535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:24.402693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f69ef5-ae50-4868-956c-e6c6e671a535 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.402979 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f69ef5-ae50-4868-956c-e6c6e671a535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.403259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f69ef5-ae50-4868-956c-e6c6e671a535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.404059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f69ef5-ae50-4868-956c-e6c6e671a535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:24.405250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:24.406441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f69ef5-ae50-4868-956c-e6c6e671a535 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:24.408020 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:24.411657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956115851d754f19aec926b760083aa0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.412586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956115851d754f19aec926b760083aa0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:24.418963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 982/1995] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:24.424648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f69ef5-ae50-4868-956c-e6c6e671a535 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:24.428079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-87f69ef5-ae50-4868-956c-e6c6e671a535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:24.442226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1014/1996] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:24 2022] DELETE /identity/v3/users/956115851d754f19aec926b760083aa0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:24.442982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:24.498998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f69ef5-ae50-4868-956c-e6c6e671a535 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:24.560812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc9f46-d4cb-413f-a369-b56c57c5675e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:24.561638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc9f46-d4cb-413f-a369-b56c57c5675e service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.561927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc9f46-d4cb-413f-a369-b56c57c5675e service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.562208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc9f46-d4cb-413f-a369-b56c57c5675e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.571995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8470da-0e2b-4e85-b381-6ac8094c033a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:24.574023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc9f46-d4cb-413f-a369-b56c57c5675e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:24.575783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc9f46-d4cb-413f-a369-b56c57c5675e service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:24.586917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb9b64-2768-4db6-b481-96f8231a967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:24.588422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9b64-2768-4db6-b481-96f8231a967c admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.589336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 983/1997] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:24.590789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9b64-2768-4db6-b481-96f8231a967c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.591875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb9b64-2768-4db6-b481-96f8231a967c admin admin] PATH_INFO: `/v3/projects/054aeae1b1c546e5b474f1ebf119498c/users/d135036c41dd406a9b3134dbc481e896/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.614115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb9b64-2768-4db6-b481-96f8231a967c admin admin] RBAC: Authorizing `identity:create_grant(project_id=054aeae1b1c546e5b474f1ebf119498c, user_id=d135036c41dd406a9b3134dbc481e896, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:24.616967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb9b64-2768-4db6-b481-96f8231a967c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:24.635523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1015/1998] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:24 2022] PUT /identity/v3/projects/054aeae1b1c546e5b474f1ebf119498c/users/d135036c41dd406a9b3134dbc481e896/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:24.646935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29951659-d3f0-44eb-8aed-0118dd16048d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.647449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29951659-d3f0-44eb-8aed-0118dd16048d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.647539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29951659-d3f0-44eb-8aed-0118dd16048d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.687549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-29951659-d3f0-44eb-8aed-0118dd16048d None None] MFA Rules not processed for user `d135036c41dd406a9b3134dbc481e896`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:24.689444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-29951659-d3f0-44eb-8aed-0118dd16048d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:24.788912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 984/1999] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:24 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:24.825934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb9b64-2768-4db6-b481-96f8231a967c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:24.827884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cabb9b64-2768-4db6-b481-96f8231a967c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:24.898298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb9b64-2768-4db6-b481-96f8231a967c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:24.901876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66d00a-c045-47e4-aa11-f718b62ad3e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:24.902573 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66d00a-c045-47e4-aa11-f718b62ad3e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:24.902872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66d00a-c045-47e4-aa11-f718b62ad3e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:24.903855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66d00a-c045-47e4-aa11-f718b62ad3e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:24.913166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66d00a-c045-47e4-aa11-f718b62ad3e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:24.914840 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f66d00a-c045-47e4-aa11-f718b62ad3e8 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:24.924997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1016/2000] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:24 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:24.940130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29951659-d3f0-44eb-8aed-0118dd16048d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:24.995533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:25.021909 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29951659-d3f0-44eb-8aed-0118dd16048d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:25.028614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:25.029710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.030045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.030321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] PATH_INFO: `/v3/users/d135036c41dd406a9b3134dbc481e896` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.031614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d135036c41dd406a9b3134dbc481e896)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:25.033553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:25.093955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd135036c41dd406a9b3134dbc481e896'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.094600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd135036c41dd406a9b3134dbc481e896'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.095892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd135036c41dd406a9b3134dbc481e896'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.125795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd135036c41dd406a9b3134dbc481e896'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.133344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66d00a-c045-47e4-aa11-f718b62ad3e8 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:25.133504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3cda9ff8-b690-4ce9-acfb-266e852d8569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd135036c41dd406a9b3134dbc481e896'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.135189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8f66d00a-c045-47e4-aa11-f718b62ad3e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:25.154258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66d00a-c045-47e4-aa11-f718b62ad3e8 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:25.161723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:25.165327 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 985/2001] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:24 2022] DELETE /identity/v3/users/d135036c41dd406a9b3134dbc481e896 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:25.166336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.166336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.166336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] PATH_INFO: `/v3/projects/2f46e2cc13904a8889e5831e2d7739a0` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.167060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52999145-e0a5-42ce-b87a-d9193a1916cf None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.167361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52999145-e0a5-42ce-b87a-d9193a1916cf None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.167662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52999145-e0a5-42ce-b87a-d9193a1916cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.167949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f46e2cc13904a8889e5831e2d7739a0)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:25.170371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:25.189362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-52999145-e0a5-42ce-b87a-d9193a1916cf None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:25.190600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-52999145-e0a5-42ce-b87a-d9193a1916cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:25.271061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f46e2cc13904a8889e5831e2d7739a0', 'request_id': 'req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.280142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:25.285516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f46e2cc13904a8889e5831e2d7739a0', 'request_id': 'req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.300742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 986/2002] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:25.302905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52999145-e0a5-42ce-b87a-d9193a1916cf None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:25.303577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f46e2cc13904a8889e5831e2d7739a0', 'request_id': 'req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.305286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-52999145-e0a5-42ce-b87a-d9193a1916cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:25.365560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] The token cache is being invalidate because project 2f46e2cc13904a8889e5831e2d7739a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:25.365914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.369249 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-bdf54cc3-d69f-4f2d-beaf-dd6266fa606c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.380096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1017/2003] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:25 2022] DELETE /identity/v3/projects/2f46e2cc13904a8889e5831e2d7739a0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:25.384096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b53eb-68c0-402d-a61d-856de2872924 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.384388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b53eb-68c0-402d-a61d-856de2872924 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.384711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b53eb-68c0-402d-a61d-856de2872924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.455150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9e3b53eb-68c0-402d-a61d-856de2872924 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:25.457138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9e3b53eb-68c0-402d-a61d-856de2872924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:25.488497 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52999145-e0a5-42ce-b87a-d9193a1916cf None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:25.522498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:25.564288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1018/2004] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:25.565322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b53eb-68c0-402d-a61d-856de2872924 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:25.566722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9e3b53eb-68c0-402d-a61d-856de2872924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:25.581214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b53eb-68c0-402d-a61d-856de2872924 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:25.587286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:25.588429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.588822 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.589419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] PATH_INFO: `/v3/projects/e5f1b6f9a3304bd9a6fea6c2aa717689` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.593904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5f1b6f9a3304bd9a6fea6c2aa717689)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:25.598732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:25.603609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f06bc-19de-498f-a32f-22984929bb18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:25.604594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f06bc-19de-498f-a32f-22984929bb18 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.605147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f06bc-19de-498f-a32f-22984929bb18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.606517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f06bc-19de-498f-a32f-22984929bb18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.612279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1d9f06bc-19de-498f-a32f-22984929bb18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:25.635594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f06bc-19de-498f-a32f-22984929bb18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:25.638689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f06bc-19de-498f-a32f-22984929bb18 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:25.650210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 987/2005] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:25.651402 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4cf6d-9d0b-4894-83fa-33cb200f9b73 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.651681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4cf6d-9d0b-4894-83fa-33cb200f9b73 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.651979 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4cf6d-9d0b-4894-83fa-33cb200f9b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.674782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e1e4cf6d-9d0b-4894-83fa-33cb200f9b73 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:25.676093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e1e4cf6d-9d0b-4894-83fa-33cb200f9b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:25.714547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5f1b6f9a3304bd9a6fea6c2aa717689', 'request_id': 'req-64bfa0b9-988a-4a6a-b640-5ddb4159950d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.722130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5f1b6f9a3304bd9a6fea6c2aa717689', 'request_id': 'req-64bfa0b9-988a-4a6a-b640-5ddb4159950d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.733463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5f1b6f9a3304bd9a6fea6c2aa717689', 'request_id': 'req-64bfa0b9-988a-4a6a-b640-5ddb4159950d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.752437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] The token cache is being invalidate because project e5f1b6f9a3304bd9a6fea6c2aa717689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:25.754640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.756177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.760660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1019/2006] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:25 2022] DELETE /identity/v3/projects/e5f1b6f9a3304bd9a6fea6c2aa717689 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:25.765007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:25.766652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:25.773448 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 988/2007] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:25.777305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4cf6d-9d0b-4894-83fa-33cb200f9b73 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:25.781839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bfa0b9-988a-4a6a-b640-5ddb4159950d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:25.788181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:25.790061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4cf6d-9d0b-4894-83fa-33cb200f9b73 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:25.790208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.790724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.791241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] PATH_INFO: `/v3/users/baf34d15157b4d958e1a87010e6dc438` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.794459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf34d15157b4d958e1a87010e6dc438)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:25.795635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67769b-9676-4bad-bfec-1122949c88be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:25.795635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67769b-9676-4bad-bfec-1122949c88be admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.798756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:25.798873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67769b-9676-4bad-bfec-1122949c88be admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.798873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67769b-9676-4bad-bfec-1122949c88be admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.798873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67769b-9676-4bad-bfec-1122949c88be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:25.798873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67769b-9676-4bad-bfec-1122949c88be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:25.800281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67769b-9676-4bad-bfec-1122949c88be admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:25.817019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 989/2008] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:31:25.820131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67769b-9676-4bad-bfec-1122949c88be admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:25.836578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67769b-9676-4bad-bfec-1122949c88be admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:25.850427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0c5f6-261c-43e8-9e7c-706e77f4de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:25.851495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0c5f6-261c-43e8-9e7c-706e77f4de3e admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:25.852147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0c5f6-261c-43e8-9e7c-706e77f4de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:25.852632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0c5f6-261c-43e8-9e7c-706e77f4de3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:25.853876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0c5f6-261c-43e8-9e7c-706e77f4de3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:25.864619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0c5f6-261c-43e8-9e7c-706e77f4de3e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:25.901788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf34d15157b4d958e1a87010e6dc438'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.902373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf34d15157b4d958e1a87010e6dc438'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.908904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 990/2009] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:25 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:25.911962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0c5f6-261c-43e8-9e7c-706e77f4de3e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:25.915820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0ed0c5f6-261c-43e8-9e7c-706e77f4de3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:25.928792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf34d15157b4d958e1a87010e6dc438'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.967331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf34d15157b4d958e1a87010e6dc438'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.971313 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf34d15157b4d958e1a87010e6dc438'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:25.978642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:26.088657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0c5f6-261c-43e8-9e7c-706e77f4de3e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:26.103587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1020/2010] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:25 2022] DELETE /identity/v3/users/baf34d15157b4d958e1a87010e6dc438 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:26.195626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:26.249868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca3394-99ac-446c-bf75-eeec8a6bf7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:26.250701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca3394-99ac-446c-bf75-eeec8a6bf7ca admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:26.250961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca3394-99ac-446c-bf75-eeec8a6bf7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:26.251268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca3394-99ac-446c-bf75-eeec8a6bf7ca admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:26.252040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca3394-99ac-446c-bf75-eeec8a6bf7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:26.254775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca3394-99ac-446c-bf75-eeec8a6bf7ca admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:26.302330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:26.302871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 991/2011] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:25 2022] POST /identity/v3/users => generated 288 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:26.318077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd834c-5176-44dc-bd39-0a470c730fa3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:26.323665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cffdd-b342-4e8a-ab96-e5393b91c726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:26.324666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cffdd-b342-4e8a-ab96-e5393b91c726 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:26.325165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cffdd-b342-4e8a-ab96-e5393b91c726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:26.325621 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cffdd-b342-4e8a-ab96-e5393b91c726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:26.326539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cffdd-b342-4e8a-ab96-e5393b91c726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:26.329262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cffdd-b342-4e8a-ab96-e5393b91c726 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:26.344574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1021/2012] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:26.349233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca3394-99ac-446c-bf75-eeec8a6bf7ca admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:26.361200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca3394-99ac-446c-bf75-eeec8a6bf7ca admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:26.366226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864c75b-cf3d-43c3-a705-46c0b9056425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:26.366976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864c75b-cf3d-43c3-a705-46c0b9056425 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:26.367262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864c75b-cf3d-43c3-a705-46c0b9056425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:26.367578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864c75b-cf3d-43c3-a705-46c0b9056425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:26.368498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864c75b-cf3d-43c3-a705-46c0b9056425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:26.370219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864c75b-cf3d-43c3-a705-46c0b9056425 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:26.381104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 992/2013] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:26.385333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cffdd-b342-4e8a-ab96-e5393b91c726 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:26.395725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cffdd-b342-4e8a-ab96-e5393b91c726 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:26.400810 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c24a0-0960-4392-85c2-c3040f8e7028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:26.401923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c24a0-0960-4392-85c2-c3040f8e7028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:26.402209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c24a0-0960-4392-85c2-c3040f8e7028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:26.402487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c24a0-0960-4392-85c2-c3040f8e7028 admin admin] PATH_INFO: `/v3/projects/0fd2400f2cfb45e18c2b00ec9e4cf94c/users/d91816dbea524da9a8d17d07a50cd3de/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:26.423508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c24a0-0960-4392-85c2-c3040f8e7028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd2400f2cfb45e18c2b00ec9e4cf94c, user_id=d91816dbea524da9a8d17d07a50cd3de, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:26.438770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c24a0-0960-4392-85c2-c3040f8e7028 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:26.470448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1022/2014] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:26 2022] PUT /identity/v3/projects/0fd2400f2cfb45e18c2b00ec9e4cf94c/users/d91816dbea524da9a8d17d07a50cd3de/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:26.483723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e6712-c4b1-4485-a088-1608f0203c64 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:26.484031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e6712-c4b1-4485-a088-1608f0203c64 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:26.484297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e6712-c4b1-4485-a088-1608f0203c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:26.522451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a37e6712-c4b1-4485-a088-1608f0203c64 None None] MFA Rules not processed for user `d91816dbea524da9a8d17d07a50cd3de`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:26.524433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a37e6712-c4b1-4485-a088-1608f0203c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:26.645284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 993/2015] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:26.658819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c24a0-0960-4392-85c2-c3040f8e7028 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:26.661001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d73c24a0-0960-4392-85c2-c3040f8e7028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:26.784321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c24a0-0960-4392-85c2-c3040f8e7028 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:26.788200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574b978-c337-4fa3-b469-a6b658bfc4d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a4ed0881004eef94166ace450b8a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:26.789043 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b978-c337-4fa3-b469-a6b658bfc4d6 service glance] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:26.789428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b978-c337-4fa3-b469-a6b658bfc4d6 service glance] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:26.789774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574b978-c337-4fa3-b469-a6b658bfc4d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:26.800786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574b978-c337-4fa3-b469-a6b658bfc4d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:26.802434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574b978-c337-4fa3-b469-a6b658bfc4d6 service glance] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:26.814628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1023/2016] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:27.335297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e6712-c4b1-4485-a088-1608f0203c64 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:27.337121 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a37e6712-c4b1-4485-a088-1608f0203c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:27.432078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e6712-c4b1-4485-a088-1608f0203c64 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:27.438532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:27.439403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:27.439690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:27.440007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] PATH_INFO: `/v3/projects/054aeae1b1c546e5b474f1ebf119498c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:27.441748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054aeae1b1c546e5b474f1ebf119498c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:27.444004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:27.543246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:27.558136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054aeae1b1c546e5b474f1ebf119498c', 'request_id': 'req-f5a36fea-6827-49a1-b235-f5439b042f21'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:27.586507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054aeae1b1c546e5b474f1ebf119498c', 'request_id': 'req-f5a36fea-6827-49a1-b235-f5439b042f21'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:27.609463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054aeae1b1c546e5b474f1ebf119498c', 'request_id': 'req-f5a36fea-6827-49a1-b235-f5439b042f21'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:27.634513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] The token cache is being invalidate because project 054aeae1b1c546e5b474f1ebf119498c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:27.634817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:27.635509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f5a36fea-6827-49a1-b235-f5439b042f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:27.644597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1c74a-856b-4ea6-a60e-21a6c1ea4329 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:27.644597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1c74a-856b-4ea6-a60e-21a6c1ea4329 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:27.644597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1c74a-856b-4ea6-a60e-21a6c1ea4329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:27.645289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 994/2017] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:27 2022] DELETE /identity/v3/projects/054aeae1b1c546e5b474f1ebf119498c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:27.663312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8ae1c74a-856b-4ea6-a60e-21a6c1ea4329 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:27.664556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8ae1c74a-856b-4ea6-a60e-21a6c1ea4329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:27.774041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107298-a31c-4d25-a0c8-d4476d4272da None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:27.774336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107298-a31c-4d25-a0c8-d4476d4272da None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:27.774744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0107298-a31c-4d25-a0c8-d4476d4272da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:27.779625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1024/2018] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:27.809184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e0107298-a31c-4d25-a0c8-d4476d4272da None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:27.811267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e0107298-a31c-4d25-a0c8-d4476d4272da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:27.825030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 995/2019] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:27.829143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1c74a-856b-4ea6-a60e-21a6c1ea4329 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:27.846510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1c74a-856b-4ea6-a60e-21a6c1ea4329 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:27.853208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d032-5071-4698-a22d-a64ebb990963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:27.854488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d032-5071-4698-a22d-a64ebb990963 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:27.854912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d032-5071-4698-a22d-a64ebb990963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:27.855629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5d032-5071-4698-a22d-a64ebb990963 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:27.856565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d032-5071-4698-a22d-a64ebb990963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:27.857038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d032-5071-4698-a22d-a64ebb990963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:27.859762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5d032-5071-4698-a22d-a64ebb990963 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:27.876925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1025/2020] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:27.881652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0107298-a31c-4d25-a0c8-d4476d4272da None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:27.894960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0107298-a31c-4d25-a0c8-d4476d4272da None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:27.909645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8b37-7c9f-4929-9550-aa0f2d10a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:27.910201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8b37-7c9f-4929-9550-aa0f2d10a0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:27.910485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8b37-7c9f-4929-9550-aa0f2d10a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:27.910762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d8b37-7c9f-4929-9550-aa0f2d10a0f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:27.912683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d8b37-7c9f-4929-9550-aa0f2d10a0f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:27.918017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d8b37-7c9f-4929-9550-aa0f2d10a0f6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:27.964587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 996/2021] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:27 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:27.969521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d032-5071-4698-a22d-a64ebb990963 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:27.985130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5d032-5071-4698-a22d-a64ebb990963 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.042155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:28.085781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6996bf-5ff0-45dd-9b72-55ad5beb249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.086131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6996bf-5ff0-45dd-9b72-55ad5beb249b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.086386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6996bf-5ff0-45dd-9b72-55ad5beb249b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.086762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6996bf-5ff0-45dd-9b72-55ad5beb249b admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.087481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6996bf-5ff0-45dd-9b72-55ad5beb249b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.089630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6996bf-5ff0-45dd-9b72-55ad5beb249b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.129352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1026/2022] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:27 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:28.133295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8b37-7c9f-4929-9550-aa0f2d10a0f6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:28.146400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d8b37-7c9f-4929-9550-aa0f2d10a0f6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.159682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba583aa8-e452-40c8-9a5e-e426d2d7d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.160375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba583aa8-e452-40c8-9a5e-e426d2d7d6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.160650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba583aa8-e452-40c8-9a5e-e426d2d7d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.160999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba583aa8-e452-40c8-9a5e-e426d2d7d6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.162306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba583aa8-e452-40c8-9a5e-e426d2d7d6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.164219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba583aa8-e452-40c8-9a5e-e426d2d7d6cd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.179606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 997/2023] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:28.183692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6996bf-5ff0-45dd-9b72-55ad5beb249b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:28.198322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6996bf-5ff0-45dd-9b72-55ad5beb249b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.204168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a3508-6a5f-4fe9-9fea-deb6177a5084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.205167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a3508-6a5f-4fe9-9fea-deb6177a5084 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.205553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a3508-6a5f-4fe9-9fea-deb6177a5084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.206662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a3508-6a5f-4fe9-9fea-deb6177a5084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.207417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a3508-6a5f-4fe9-9fea-deb6177a5084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.209873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a3508-6a5f-4fe9-9fea-deb6177a5084 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.228902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1027/2024] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:28.230008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba583aa8-e452-40c8-9a5e-e426d2d7d6cd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:28.250404 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba583aa8-e452-40c8-9a5e-e426d2d7d6cd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.262911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1784a-f3fc-46e8-ab64-47ca3d1b911d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.264052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1784a-f3fc-46e8-ab64-47ca3d1b911d admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.264452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1784a-f3fc-46e8-ab64-47ca3d1b911d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.264727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1784a-f3fc-46e8-ab64-47ca3d1b911d admin admin] PATH_INFO: `/v3/projects/85355daee9e040fb8ef53cea3a64d1f9/users/876a2df582804d9d98c86c4ec83c817c/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.270275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a3508-6a5f-4fe9-9fea-deb6177a5084 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:28.274652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d70a3508-6a5f-4fe9-9fea-deb6177a5084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:28.294214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a3508-6a5f-4fe9-9fea-deb6177a5084 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.301664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.302675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.303025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.303321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] PATH_INFO: `/v3/projects/83b733433cc4475087331c49fc2850b0` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.304651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b733433cc4475087331c49fc2850b0)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.306712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.323297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1784a-f3fc-46e8-ab64-47ca3d1b911d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85355daee9e040fb8ef53cea3a64d1f9, user_id=876a2df582804d9d98c86c4ec83c817c, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.328073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1784a-f3fc-46e8-ab64-47ca3d1b911d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.347875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 998/2025] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:28 2022] PUT /identity/v3/projects/85355daee9e040fb8ef53cea3a64d1f9/users/876a2df582804d9d98c86c4ec83c817c/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:28.370813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3afb-0d6b-4f4c-a129-b184168372f7 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.371156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3afb-0d6b-4f4c-a129-b184168372f7 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.371442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3afb-0d6b-4f4c-a129-b184168372f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.371905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b733433cc4475087331c49fc2850b0', 'request_id': 'req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:28.379154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b733433cc4475087331c49fc2850b0', 'request_id': 'req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:28.392139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b733433cc4475087331c49fc2850b0', 'request_id': 'req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:28.405272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] The token cache is being invalidate because project 83b733433cc4475087331c49fc2850b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:28.405594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:28.406292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e3a2f541-8e54-4524-9c32-0f7535bcd6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:28.408152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1028/2026] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:28 2022] DELETE /identity/v3/projects/83b733433cc4475087331c49fc2850b0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:28.412588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb74312-4d7f-47ed-b2ad-cf8e1939e087 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.412926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb74312-4d7f-47ed-b2ad-cf8e1939e087 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.413208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb74312-4d7f-47ed-b2ad-cf8e1939e087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.420270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-55dd3afb-0d6b-4f4c-a129-b184168372f7 None None] MFA Rules not processed for user `876a2df582804d9d98c86c4ec83c817c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:28.422063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-55dd3afb-0d6b-4f4c-a129-b184168372f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:28.432881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fdb74312-4d7f-47ed-b2ad-cf8e1939e087 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:28.436103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fdb74312-4d7f-47ed-b2ad-cf8e1939e087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:28.505330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1029/2027] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:28.512787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07744ecb-950f-4860-a9f9-c634620c757a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.513133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07744ecb-950f-4860-a9f9-c634620c757a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.513522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07744ecb-950f-4860-a9f9-c634620c757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.519138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 999/2028] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:28.532125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd3afb-0d6b-4f4c-a129-b184168372f7 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:28.533993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-55dd3afb-0d6b-4f4c-a129-b184168372f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:28.550803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-07744ecb-950f-4860-a9f9-c634620c757a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:28.553042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-07744ecb-950f-4860-a9f9-c634620c757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:28.561866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1030/2029] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:28.569572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07744ecb-950f-4860-a9f9-c634620c757a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:28.580576 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07744ecb-950f-4860-a9f9-c634620c757a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.587000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1555dc2-8379-4ac3-bd38-d7660a2c4fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.587791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1555dc2-8379-4ac3-bd38-d7660a2c4fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.588074 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1555dc2-8379-4ac3-bd38-d7660a2c4fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.588354 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1555dc2-8379-4ac3-bd38-d7660a2c4fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.589350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1555dc2-8379-4ac3-bd38-d7660a2c4fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:28.589659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1555dc2-8379-4ac3-bd38-d7660a2c4fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.591381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1555dc2-8379-4ac3-bd38-d7660a2c4fd1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.620178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd3afb-0d6b-4f4c-a129-b184168372f7 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.620726 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1031/2030] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:28.625126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d8038-041f-413a-84aa-876c975dae65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a4ed0881004eef94166ace450b8a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.625918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d8038-041f-413a-84aa-876c975dae65 service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.626039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1555dc2-8379-4ac3-bd38-d7660a2c4fd1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:28.626255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d8038-041f-413a-84aa-876c975dae65 service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.626660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d8038-041f-413a-84aa-876c975dae65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.639324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1555dc2-8379-4ac3-bd38-d7660a2c4fd1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.645730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d8038-041f-413a-84aa-876c975dae65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.647023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1577ce8-eb02-4351-b4ed-2732b945c181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.647262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d8038-041f-413a-84aa-876c975dae65 service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.647872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1577ce8-eb02-4351-b4ed-2732b945c181 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.648163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1577ce8-eb02-4351-b4ed-2732b945c181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.648441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1577ce8-eb02-4351-b4ed-2732b945c181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.649186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1577ce8-eb02-4351-b4ed-2732b945c181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.652395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1577ce8-eb02-4351-b4ed-2732b945c181 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.669967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:28.680601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1000/2031] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:31:28.728566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1032/2032] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:28 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:28.731892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d8038-041f-413a-84aa-876c975dae65 service glance] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:28.753903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:28.757709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d8038-041f-413a-84aa-876c975dae65 service glance] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.880749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508b788-4a65-4504-8e5c-38d99d90f4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.881546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508b788-4a65-4504-8e5c-38d99d90f4e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.881892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508b788-4a65-4504-8e5c-38d99d90f4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.882752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508b788-4a65-4504-8e5c-38d99d90f4e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.883532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508b788-4a65-4504-8e5c-38d99d90f4e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.887759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5508b788-4a65-4504-8e5c-38d99d90f4e3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.920758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1001/2033] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:28 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:28.925036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1577ce8-eb02-4351-b4ed-2732b945c181 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:28.935981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1577ce8-eb02-4351-b4ed-2732b945c181 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:28.942609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1eec2-6d4c-48b8-8fba-8dff5d58113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:28.943620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1eec2-6d4c-48b8-8fba-8dff5d58113c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:28.943798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1eec2-6d4c-48b8-8fba-8dff5d58113c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:28.944204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1eec2-6d4c-48b8-8fba-8dff5d58113c admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:28.945053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1eec2-6d4c-48b8-8fba-8dff5d58113c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:28.946671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1eec2-6d4c-48b8-8fba-8dff5d58113c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:28.994291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1033/2034] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:28.995665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508b788-4a65-4504-8e5c-38d99d90f4e3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:29.011205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508b788-4a65-4504-8e5c-38d99d90f4e3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:29.028438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd511bd-47a9-49e6-9b74-e9d8bc9eaa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:29.029220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd511bd-47a9-49e6-9b74-e9d8bc9eaa45 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:29.029537 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd511bd-47a9-49e6-9b74-e9d8bc9eaa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:29.031298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd511bd-47a9-49e6-9b74-e9d8bc9eaa45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:29.032132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd511bd-47a9-49e6-9b74-e9d8bc9eaa45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:29.034016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd511bd-47a9-49e6-9b74-e9d8bc9eaa45 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:29.055792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1002/2035] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:29.060754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1eec2-6d4c-48b8-8fba-8dff5d58113c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:29.080964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1eec2-6d4c-48b8-8fba-8dff5d58113c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:29.087200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb178d3-4189-4a1d-89cc-7f92ae35c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:29.088350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb178d3-4189-4a1d-89cc-7f92ae35c78d admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:29.088632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb178d3-4189-4a1d-89cc-7f92ae35c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:29.088938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb178d3-4189-4a1d-89cc-7f92ae35c78d admin admin] PATH_INFO: `/v3/projects/02dccdea9b8f411f86787ed4b6089742/users/fa4b4a302f82453c9f9a45b937c4ddcb/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:29.124340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb178d3-4189-4a1d-89cc-7f92ae35c78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02dccdea9b8f411f86787ed4b6089742, user_id=fa4b4a302f82453c9f9a45b937c4ddcb, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:29.127003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb178d3-4189-4a1d-89cc-7f92ae35c78d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:29.154374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1034/2036] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:29 2022] PUT /identity/v3/projects/02dccdea9b8f411f86787ed4b6089742/users/fa4b4a302f82453c9f9a45b937c4ddcb/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:29.168602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c7fba-5ae6-42c2-a2da-f4209dd9825c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:29.169224 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c7fba-5ae6-42c2-a2da-f4209dd9825c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:29.169716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c7fba-5ae6-42c2-a2da-f4209dd9825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:29.225903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d25c7fba-5ae6-42c2-a2da-f4209dd9825c None None] MFA Rules not processed for user `fa4b4a302f82453c9f9a45b937c4ddcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:29.227199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d25c7fba-5ae6-42c2-a2da-f4209dd9825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:29.331699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1003/2037] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:29.336693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb178d3-4189-4a1d-89cc-7f92ae35c78d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:29.433761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb178d3-4189-4a1d-89cc-7f92ae35c78d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:29.449594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ac357-fe41-4cd7-8887-28666d2d380d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:29.450289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ac357-fe41-4cd7-8887-28666d2d380d admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:29.450575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ac357-fe41-4cd7-8887-28666d2d380d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:29.450849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ac357-fe41-4cd7-8887-28666d2d380d admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:29.451717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ac357-fe41-4cd7-8887-28666d2d380d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:29.457273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ac357-fe41-4cd7-8887-28666d2d380d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:29.526797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1035/2038] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:29 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:29.528704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c7fba-5ae6-42c2-a2da-f4209dd9825c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:29.545486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c7fba-5ae6-42c2-a2da-f4209dd9825c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:29.636586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ea65a-b135-471e-b7fd-1903b4e64732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:29.637368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ea65a-b135-471e-b7fd-1903b4e64732 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:29.637650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ea65a-b135-471e-b7fd-1903b4e64732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:29.637921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ea65a-b135-471e-b7fd-1903b4e64732 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:29.638875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ea65a-b135-471e-b7fd-1903b4e64732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:29.641054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ea65a-b135-471e-b7fd-1903b4e64732 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:29.686144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:29.696373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1004/2039] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:29 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:29.700616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ac357-fe41-4cd7-8887-28666d2d380d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:29.737575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ac357-fe41-4cd7-8887-28666d2d380d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:29.755175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c891c1-1039-4287-a0dc-d74bc3727be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:29.756237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c891c1-1039-4287-a0dc-d74bc3727be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:29.756585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c891c1-1039-4287-a0dc-d74bc3727be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:29.757115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c891c1-1039-4287-a0dc-d74bc3727be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:29.758011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c891c1-1039-4287-a0dc-d74bc3727be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:29.763034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c891c1-1039-4287-a0dc-d74bc3727be9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:29.805768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ea65a-b135-471e-b7fd-1903b4e64732 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:29.806241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1036/2040] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:29.830109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ea65a-b135-471e-b7fd-1903b4e64732 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:29.837303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a30352-0cc9-47b1-b574-f74f2fa92c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:29.838531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a30352-0cc9-47b1-b574-f74f2fa92c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:29.838983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a30352-0cc9-47b1-b574-f74f2fa92c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:29.839459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a30352-0cc9-47b1-b574-f74f2fa92c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:29.840377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a30352-0cc9-47b1-b574-f74f2fa92c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:29.842521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a30352-0cc9-47b1-b574-f74f2fa92c92 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:29.859185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1005/2041] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:29.863491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c891c1-1039-4287-a0dc-d74bc3727be9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:29.880203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c891c1-1039-4287-a0dc-d74bc3727be9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:29.893621 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ca4a5-9b80-4fa9-ad3d-202945c63038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:29.895052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ca4a5-9b80-4fa9-ad3d-202945c63038 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:29.900329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ca4a5-9b80-4fa9-ad3d-202945c63038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:29.900885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ca4a5-9b80-4fa9-ad3d-202945c63038 admin admin] PATH_INFO: `/v3/projects/63018953b0fc4dfdbd9744a4662d2883/users/c71f50f071d74231a90e81795d26163a/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:29.938206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ca4a5-9b80-4fa9-ad3d-202945c63038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63018953b0fc4dfdbd9744a4662d2883, user_id=c71f50f071d74231a90e81795d26163a, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:29.943532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ca4a5-9b80-4fa9-ad3d-202945c63038 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:30.000893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1037/2042] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:29 2022] PUT /identity/v3/projects/63018953b0fc4dfdbd9744a4662d2883/users/c71f50f071d74231a90e81795d26163a/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:30.005843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e80e3-0fa2-4eea-b0be-a4c647d3e6f4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:30.006188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e80e3-0fa2-4eea-b0be-a4c647d3e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:30.006406 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e80e3-0fa2-4eea-b0be-a4c647d3e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:30.077063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-de0e80e3-0fa2-4eea-b0be-a4c647d3e6f4 None None] MFA Rules not processed for user `c71f50f071d74231a90e81795d26163a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:30.089793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-de0e80e3-0fa2-4eea-b0be-a4c647d3e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:30.255577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1006/2043] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:30.260009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ca4a5-9b80-4fa9-ad3d-202945c63038 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:30.345553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ca4a5-9b80-4fa9-ad3d-202945c63038 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:30.352000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10398cdb-7774-4498-9608-ab7308045a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:30.353466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10398cdb-7774-4498-9608-ab7308045a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:30.353970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10398cdb-7774-4498-9608-ab7308045a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:30.354324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10398cdb-7774-4498-9608-ab7308045a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:30.355111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10398cdb-7774-4498-9608-ab7308045a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:30.357882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10398cdb-7774-4498-9608-ab7308045a6e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:30.373601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:30.411699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1038/2044] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:30 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:30.415727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e80e3-0fa2-4eea-b0be-a4c647d3e6f4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:30.435600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e80e3-0fa2-4eea-b0be-a4c647d3e6f4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:30.613262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b58bf-4098-416d-8b55-a9ec6efb6ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:30.614050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b58bf-4098-416d-8b55-a9ec6efb6ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:30.614259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b58bf-4098-416d-8b55-a9ec6efb6ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:30.614589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b58bf-4098-416d-8b55-a9ec6efb6ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:30.615896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b58bf-4098-416d-8b55-a9ec6efb6ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:30.619347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b58bf-4098-416d-8b55-a9ec6efb6ca0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:30.657025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1007/2045] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:30 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:30.657994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10398cdb-7774-4498-9608-ab7308045a6e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:30.671617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10398cdb-7774-4498-9608-ab7308045a6e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:30.676746 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344c17-6306-46c7-b1ad-23b1fbca08e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:30.677558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344c17-6306-46c7-b1ad-23b1fbca08e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:30.678018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344c17-6306-46c7-b1ad-23b1fbca08e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:30.678371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344c17-6306-46c7-b1ad-23b1fbca08e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:30.679212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344c17-6306-46c7-b1ad-23b1fbca08e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:30.681296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344c17-6306-46c7-b1ad-23b1fbca08e7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:30.700634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1039/2046] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:30.709458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b58bf-4098-416d-8b55-a9ec6efb6ca0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:30.731348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b58bf-4098-416d-8b55-a9ec6efb6ca0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:30.738116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bedfd-baae-41b8-8784-228da3f7f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:30.739169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bedfd-baae-41b8-8784-228da3f7f0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:30.739687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bedfd-baae-41b8-8784-228da3f7f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:30.739984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bedfd-baae-41b8-8784-228da3f7f0a1 admin admin] PATH_INFO: `/v3/projects/c89d259fd2a2483a9714d566fb319235/users/27777d2181cd4d99846f214a79ee12a1/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:30.767864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bedfd-baae-41b8-8784-228da3f7f0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89d259fd2a2483a9714d566fb319235, user_id=27777d2181cd4d99846f214a79ee12a1, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:30.770853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9bedfd-baae-41b8-8784-228da3f7f0a1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:30.791194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1008/2047] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:30 2022] PUT /identity/v3/projects/c89d259fd2a2483a9714d566fb319235/users/27777d2181cd4d99846f214a79ee12a1/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:30.795131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344c17-6306-46c7-b1ad-23b1fbca08e7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:30.808739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344c17-6306-46c7-b1ad-23b1fbca08e7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:30.952692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0de5f-472f-4a4b-8038-4f58208c8c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:30.953766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0de5f-472f-4a4b-8038-4f58208c8c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:30.954160 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0de5f-472f-4a4b-8038-4f58208c8c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:30.954526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0de5f-472f-4a4b-8038-4f58208c8c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:30.955352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0de5f-472f-4a4b-8038-4f58208c8c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:30.958105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0de5f-472f-4a4b-8038-4f58208c8c29 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:30.972218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1040/2048] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:30.977179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bedfd-baae-41b8-8784-228da3f7f0a1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:30.992240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bedfd-baae-41b8-8784-228da3f7f0a1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:30.997301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2892ba-852d-4970-983d-b257ca56638b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:30.998432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2892ba-852d-4970-983d-b257ca56638b admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:30.998852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2892ba-852d-4970-983d-b257ca56638b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:30.999225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2892ba-852d-4970-983d-b257ca56638b admin admin] PATH_INFO: `/v3/projects/c89d259fd2a2483a9714d566fb319235/users/27777d2181cd4d99846f214a79ee12a1/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:31.001997 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2892ba-852d-4970-983d-b257ca56638b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89d259fd2a2483a9714d566fb319235, user_id=27777d2181cd4d99846f214a79ee12a1, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:31.005036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2892ba-852d-4970-983d-b257ca56638b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:31.019241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1009/2049] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:30 2022] PUT /identity/v3/projects/c89d259fd2a2483a9714d566fb319235/users/27777d2181cd4d99846f214a79ee12a1/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:31.031097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076190d-78e6-4d45-bc98-e900f717cffe None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:31.031625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076190d-78e6-4d45-bc98-e900f717cffe None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:31.032053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076190d-78e6-4d45-bc98-e900f717cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:31.081975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8076190d-78e6-4d45-bc98-e900f717cffe None None] MFA Rules not processed for user `27777d2181cd4d99846f214a79ee12a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:31.083274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8076190d-78e6-4d45-bc98-e900f717cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:31.186476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1041/2050] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:31.195269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2892ba-852d-4970-983d-b257ca56638b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:31.199309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cf2892ba-852d-4970-983d-b257ca56638b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:31.282577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:31.320224 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2892ba-852d-4970-983d-b257ca56638b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:31.329939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d94f6-e495-44be-b55a-74ea1e5af240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:31.330849 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d94f6-e495-44be-b55a-74ea1e5af240 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:31.331201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d94f6-e495-44be-b55a-74ea1e5af240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:31.331590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d94f6-e495-44be-b55a-74ea1e5af240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:31.347590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d94f6-e495-44be-b55a-74ea1e5af240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:31.349241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d94f6-e495-44be-b55a-74ea1e5af240 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:31.370057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1010/2051] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:32.135693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076190d-78e6-4d45-bc98-e900f717cffe None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:32.137311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8076190d-78e6-4d45-bc98-e900f717cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:32.149944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076190d-78e6-4d45-bc98-e900f717cffe None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:32.157869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e66d5-7cc9-4435-a52d-51e196db1989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:32.158548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e66d5-7cc9-4435-a52d-51e196db1989 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:32.158825 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e66d5-7cc9-4435-a52d-51e196db1989 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:32.159104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e66d5-7cc9-4435-a52d-51e196db1989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:32.217748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e66d5-7cc9-4435-a52d-51e196db1989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:32.219278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e66d5-7cc9-4435-a52d-51e196db1989 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:32.231861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1042/2052] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:36.476126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d94f6-e495-44be-b55a-74ea1e5af240 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:36.489539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d94f6-e495-44be-b55a-74ea1e5af240 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:36.495532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfe8b9-9643-4d44-a442-c5ac3762e058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:36.496372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfe8b9-9643-4d44-a442-c5ac3762e058 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:36.496759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfe8b9-9643-4d44-a442-c5ac3762e058 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:36.497489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfe8b9-9643-4d44-a442-c5ac3762e058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:36.628924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfe8b9-9643-4d44-a442-c5ac3762e058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:36.630552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfe8b9-9643-4d44-a442-c5ac3762e058 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:36.649041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1011/2053] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:37.887858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61a4a4-3fd1-4a17-a822-5e74e74fd0e8 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:37.888407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61a4a4-3fd1-4a17-a822-5e74e74fd0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:37.888407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61a4a4-3fd1-4a17-a822-5e74e74fd0e8 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:37.889806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1043/2054] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:31:37.899635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c2ddb-5188-433e-8b3d-9b57d0557ded None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:37.900148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c2ddb-5188-433e-8b3d-9b57d0557ded None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:37.900148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c2ddb-5188-433e-8b3d-9b57d0557ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:37.923497 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ff0c2ddb-5188-433e-8b3d-9b57d0557ded None None] MFA Rules not processed for user `eb3ded7163fa400399d1b09079a366ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:37.924723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ff0c2ddb-5188-433e-8b3d-9b57d0557ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:37.979567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61a4a4-3fd1-4a17-a822-5e74e74fd0e8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:37.981836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0d61a4a4-3fd1-4a17-a822-5e74e74fd0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:37.991546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:38.039784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1012/2055] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:31:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:38.054708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c2ddb-5188-433e-8b3d-9b57d0557ded None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:38.056184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ff0c2ddb-5188-433e-8b3d-9b57d0557ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:38.070805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c2ddb-5188-433e-8b3d-9b57d0557ded None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:38.076642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33d704-a77d-4154-a321-5c451f7d4e84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:38.077595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33d704-a77d-4154-a321-5c451f7d4e84 service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:38.077975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33d704-a77d-4154-a321-5c451f7d4e84 service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:38.078369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd33d704-a77d-4154-a321-5c451f7d4e84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:38.091658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d61a4a4-3fd1-4a17-a822-5e74e74fd0e8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:38.093034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33d704-a77d-4154-a321-5c451f7d4e84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:38.096119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd33d704-a77d-4154-a321-5c451f7d4e84 service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:38.098612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:38.100275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:38.100275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:38.100275 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] PATH_INFO: `/v3/users/23265f35b4c44341b9bca85b613f56af` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:38.101803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23265f35b4c44341b9bca85b613f56af)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:38.103734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:38.108941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1013/2056] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:38.172612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23265f35b4c44341b9bca85b613f56af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.173537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23265f35b4c44341b9bca85b613f56af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.188161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23265f35b4c44341b9bca85b613f56af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.199413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23265f35b4c44341b9bca85b613f56af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.199413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae30ec3a-33b5-49b1-b09d-21855d2924a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23265f35b4c44341b9bca85b613f56af'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.214352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1044/2057] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:37 2022] DELETE /identity/v3/users/23265f35b4c44341b9bca85b613f56af => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:38.444466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33d704-a77d-4154-a321-5c451f7d4e84 service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:38.458210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd33d704-a77d-4154-a321-5c451f7d4e84 service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:38.522635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:38.530440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:38.531607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:38.531883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:38.532179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] PATH_INFO: `/v3/projects/198dc2d330dc4d4fa06a230ddef76ea1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:38.533401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198dc2d330dc4d4fa06a230ddef76ea1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:38.535387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:38.593462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198dc2d330dc4d4fa06a230ddef76ea1', 'request_id': 'req-9bc780b6-f325-44cb-95ae-f10ba8e90790'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.601591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198dc2d330dc4d4fa06a230ddef76ea1', 'request_id': 'req-9bc780b6-f325-44cb-95ae-f10ba8e90790'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.610957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198dc2d330dc4d4fa06a230ddef76ea1', 'request_id': 'req-9bc780b6-f325-44cb-95ae-f10ba8e90790'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.631104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] The token cache is being invalidate because project 198dc2d330dc4d4fa06a230ddef76ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:38.631302 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.632371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9bc780b6-f325-44cb-95ae-f10ba8e90790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:38.633878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1014/2058] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:38 2022] DELETE /identity/v3/projects/198dc2d330dc4d4fa06a230ddef76ea1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:38.639340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c00e2-be69-4b78-a92d-9580fd74dbd6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:38.639678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c00e2-be69-4b78-a92d-9580fd74dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:38.640063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c00e2-be69-4b78-a92d-9580fd74dbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:38.664832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bf5c00e2-be69-4b78-a92d-9580fd74dbd6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:38.666298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bf5c00e2-be69-4b78-a92d-9580fd74dbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:38.764319 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1045/2059] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:38.773059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45674c-8fe4-4cb3-ae22-ae63fee1ecdd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:38.773503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45674c-8fe4-4cb3-ae22-ae63fee1ecdd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:38.774221 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45674c-8fe4-4cb3-ae22-ae63fee1ecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:38.811050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-eb45674c-8fe4-4cb3-ae22-ae63fee1ecdd None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:38.812335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eb45674c-8fe4-4cb3-ae22-ae63fee1ecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:38.824187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1015/2060] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:38.825782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c00e2-be69-4b78-a92d-9580fd74dbd6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:38.836476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c00e2-be69-4b78-a92d-9580fd74dbd6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:38.841624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9566e-c9a8-42ae-865d-b2673b43d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:38.846234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9566e-c9a8-42ae-865d-b2673b43d54d admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:38.846528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9566e-c9a8-42ae-865d-b2673b43d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:38.846947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9566e-c9a8-42ae-865d-b2673b43d54d admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:38.847869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9566e-c9a8-42ae-865d-b2673b43d54d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:38.848169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9566e-c9a8-42ae-865d-b2673b43d54d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:38.850053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9566e-c9a8-42ae-865d-b2673b43d54d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:38.867168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1046/2061] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:38.868758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45674c-8fe4-4cb3-ae22-ae63fee1ecdd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:38.878919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45674c-8fe4-4cb3-ae22-ae63fee1ecdd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:38.885735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91abb9-0b6b-46da-a4a6-4be90604e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:38.886609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91abb9-0b6b-46da-a4a6-4be90604e4ad admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:38.886895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91abb9-0b6b-46da-a4a6-4be90604e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:38.887162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91abb9-0b6b-46da-a4a6-4be90604e4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:38.887903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91abb9-0b6b-46da-a4a6-4be90604e4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:38.890218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91abb9-0b6b-46da-a4a6-4be90604e4ad admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:38.922558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1016/2062] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:38 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:38.927222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9566e-c9a8-42ae-865d-b2673b43d54d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:38.938901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9566e-c9a8-42ae-865d-b2673b43d54d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:38.947432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:39.023596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29524a-bf49-410b-a946-a0dfe9f75aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:39.024436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29524a-bf49-410b-a946-a0dfe9f75aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:39.024803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29524a-bf49-410b-a946-a0dfe9f75aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:39.025106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29524a-bf49-410b-a946-a0dfe9f75aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:39.026115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29524a-bf49-410b-a946-a0dfe9f75aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:39.028955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29524a-bf49-410b-a946-a0dfe9f75aeb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:39.051674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1047/2063] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:38 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:39.059490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91abb9-0b6b-46da-a4a6-4be90604e4ad admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:39.071306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91abb9-0b6b-46da-a4a6-4be90604e4ad admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:39.076159 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754f559-d55a-4c19-a6d3-cb0a4410df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:39.077050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754f559-d55a-4c19-a6d3-cb0a4410df72 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:39.077330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754f559-d55a-4c19-a6d3-cb0a4410df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:39.077734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754f559-d55a-4c19-a6d3-cb0a4410df72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:39.078481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754f559-d55a-4c19-a6d3-cb0a4410df72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:39.080152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754f559-d55a-4c19-a6d3-cb0a4410df72 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:39.091577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1017/2064] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:39.096154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29524a-bf49-410b-a946-a0dfe9f75aeb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:39.114193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29524a-bf49-410b-a946-a0dfe9f75aeb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:39.119228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5948b-4411-4072-9709-bf3e7f32b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:39.119910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5948b-4411-4072-9709-bf3e7f32b5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:39.120388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5948b-4411-4072-9709-bf3e7f32b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:39.120513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5948b-4411-4072-9709-bf3e7f32b5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:39.121211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5948b-4411-4072-9709-bf3e7f32b5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:39.122841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5948b-4411-4072-9709-bf3e7f32b5c5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:39.138545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1048/2065] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:39.142831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754f559-d55a-4c19-a6d3-cb0a4410df72 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:39.153077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754f559-d55a-4c19-a6d3-cb0a4410df72 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:39.161673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe02f0c-b170-4136-9739-a1ca6a9276ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:39.162583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe02f0c-b170-4136-9739-a1ca6a9276ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:39.162863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe02f0c-b170-4136-9739-a1ca6a9276ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:39.163137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe02f0c-b170-4136-9739-a1ca6a9276ed admin admin] PATH_INFO: `/v3/projects/5e9dcbd7ff1b46179cf0890a742ba54c/users/547c76ec433a42cdb3d2b7a7f55856b0/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:39.179965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe02f0c-b170-4136-9739-a1ca6a9276ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e9dcbd7ff1b46179cf0890a742ba54c, user_id=547c76ec433a42cdb3d2b7a7f55856b0, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:39.181648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5948b-4411-4072-9709-bf3e7f32b5c5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:39.182983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe02f0c-b170-4136-9739-a1ca6a9276ed admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:39.183383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0ea5948b-4411-4072-9709-bf3e7f32b5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:39.197458 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5948b-4411-4072-9709-bf3e7f32b5c5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:39.198858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1018/2066] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:39 2022] PUT /identity/v3/projects/5e9dcbd7ff1b46179cf0890a742ba54c/users/547c76ec433a42cdb3d2b7a7f55856b0/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:39.206990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fa87-765c-4126-ae46-016b76496467 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:39.206990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fa87-765c-4126-ae46-016b76496467 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:39.206990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3fa87-765c-4126-ae46-016b76496467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:39.223451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dbb3fa87-765c-4126-ae46-016b76496467 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:39.224909 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dbb3fa87-765c-4126-ae46-016b76496467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:39.266209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:39.267080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:39.267354 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:39.267622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] PATH_INFO: `/v3/users/fa4b4a302f82453c9f9a45b937c4ddcb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:39.269395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4b4a302f82453c9f9a45b937c4ddcb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:39.272025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:39.292177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1019/2067] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:39.302090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3fa87-765c-4126-ae46-016b76496467 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:39.304173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dbb3fa87-765c-4126-ae46-016b76496467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:39.341416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:39.345478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4b4a302f82453c9f9a45b937c4ddcb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:39.346191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4b4a302f82453c9f9a45b937c4ddcb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:39.358978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4b4a302f82453c9f9a45b937c4ddcb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:39.371564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4b4a302f82453c9f9a45b937c4ddcb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:39.372445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e6d2f97c-2f05-4e8a-a867-2880c27ef9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4b4a302f82453c9f9a45b937c4ddcb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:39.384894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3fa87-765c-4126-ae46-016b76496467 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:39.391731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:39.392518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:39.392862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:39.393248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:39.393635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1049/2068] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:39 2022] DELETE /identity/v3/users/fa4b4a302f82453c9f9a45b937c4ddcb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:39.395243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:39.403640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca87d-b18c-43b0-a2dc-61670cb74361 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:39.403931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca87d-b18c-43b0-a2dc-61670cb74361 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:39.404211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ca87d-b18c-43b0-a2dc-61670cb74361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:39.408542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:39.410038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:39.419607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1020/2069] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:39.424306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-051ca87d-b18c-43b0-a2dc-61670cb74361 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:39.425597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-051ca87d-b18c-43b0-a2dc-61670cb74361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:39.430872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:39.511858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1050/2070] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:39.522333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:39.523801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:39.537623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73272-beda-46da-a29b-5a40de719969 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:39.598084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a0b52-1161-4705-ad3d-1f2172a1589c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:39.598871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a0b52-1161-4705-ad3d-1f2172a1589c service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:39.599216 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a0b52-1161-4705-ad3d-1f2172a1589c service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:39.599501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a0b52-1161-4705-ad3d-1f2172a1589c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:39.614354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a0b52-1161-4705-ad3d-1f2172a1589c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:39.615389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a0b52-1161-4705-ad3d-1f2172a1589c service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:39.627317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1021/2071] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:40.111948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ca87d-b18c-43b0-a2dc-61670cb74361 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.113656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-051ca87d-b18c-43b0-a2dc-61670cb74361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:40.135195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ca87d-b18c-43b0-a2dc-61670cb74361 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:40.142312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:40.143114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.143401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.143674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] PATH_INFO: `/v3/projects/02dccdea9b8f411f86787ed4b6089742` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.155232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4fc7c-b60e-4af3-9e7d-0fc22bf1ea97 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.155775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4fc7c-b60e-4af3-9e7d-0fc22bf1ea97 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.155872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4fc7c-b60e-4af3-9e7d-0fc22bf1ea97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.157011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=02dccdea9b8f411f86787ed4b6089742)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:40.160936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:40.193235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dde4fc7c-b60e-4af3-9e7d-0fc22bf1ea97 None None] MFA Rules not processed for user `547c76ec433a42cdb3d2b7a7f55856b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:40.194477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dde4fc7c-b60e-4af3-9e7d-0fc22bf1ea97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:40.242776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02dccdea9b8f411f86787ed4b6089742', 'request_id': 'req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.248939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02dccdea9b8f411f86787ed4b6089742', 'request_id': 'req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.260320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02dccdea9b8f411f86787ed4b6089742', 'request_id': 'req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.274140 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] The token cache is being invalidate because project 02dccdea9b8f411f86787ed4b6089742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:40.274719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.275421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.276780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1022/2072] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:40.277287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1051/2073] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:40 2022] DELETE /identity/v3/projects/02dccdea9b8f411f86787ed4b6089742 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:40.281325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4fc7c-b60e-4af3-9e7d-0fc22bf1ea97 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.284254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.286368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:40.294244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4fc7c-b60e-4af3-9e7d-0fc22bf1ea97 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:40.356702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:40.362931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6efc0d5-3be7-46ae-93b9-41ed4abd9e8a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:40.364137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:40.365475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.365946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.366408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] PATH_INFO: `/v3/users/c71f50f071d74231a90e81795d26163a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.368891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2288b-311d-4b18-9643-757abc9f76a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:40.369023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71f50f071d74231a90e81795d26163a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:40.369114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2288b-311d-4b18-9643-757abc9f76a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.369114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2288b-311d-4b18-9643-757abc9f76a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.373637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2288b-311d-4b18-9643-757abc9f76a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.373637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2288b-311d-4b18-9643-757abc9f76a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:40.373891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:40.373998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2288b-311d-4b18-9643-757abc9f76a1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:40.407310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1052/2074] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:40 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:40.411237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2288b-311d-4b18-9643-757abc9f76a1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.431209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71f50f071d74231a90e81795d26163a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.431878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71f50f071d74231a90e81795d26163a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.432491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71f50f071d74231a90e81795d26163a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.433091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:40.447981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71f50f071d74231a90e81795d26163a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.458387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71f50f071d74231a90e81795d26163a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.479546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1023/2075] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:40 2022] DELETE /identity/v3/users/c71f50f071d74231a90e81795d26163a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:40.495852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2288b-311d-4b18-9643-757abc9f76a1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:40.577571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6376-ada3-46cd-9aa6-c767b1471af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:40.578748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6376-ada3-46cd-9aa6-c767b1471af2 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.579243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6376-ada3-46cd-9aa6-c767b1471af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.579514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f6376-ada3-46cd-9aa6-c767b1471af2 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.580239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6376-ada3-46cd-9aa6-c767b1471af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:40.582648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f6376-ada3-46cd-9aa6-c767b1471af2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:40.621296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1053/2076] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:40 2022] POST /identity/v3/users => generated 308 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:40.625492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.627333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:40.640494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef889853-8182-4705-b42f-c2d73cee1513 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:40.645105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ae64-3037-4a53-9d07-5bda13d8bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:40.645786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ae64-3037-4a53-9d07-5bda13d8bf65 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.646062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ae64-3037-4a53-9d07-5bda13d8bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.646334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ae64-3037-4a53-9d07-5bda13d8bf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.647069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ae64-3037-4a53-9d07-5bda13d8bf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:40.648680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ae64-3037-4a53-9d07-5bda13d8bf65 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:40.663643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1024/2077] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:40.668138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6376-ada3-46cd-9aa6-c767b1471af2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.678216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f6376-ada3-46cd-9aa6-c767b1471af2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:40.682784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c9023-9c21-4580-85c1-8cd88fdeaa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:40.683660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9023-9c21-4580-85c1-8cd88fdeaa5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.683938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9023-9c21-4580-85c1-8cd88fdeaa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.684211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9023-9c21-4580-85c1-8cd88fdeaa5e admin admin] PATH_INFO: `/v3/projects/9c1ba1a518e2430dbc5bd1e514a6d1da/users/d5fbf1acce354f52828bc69d79bdd9ae/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.699891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c9023-9c21-4580-85c1-8cd88fdeaa5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1ba1a518e2430dbc5bd1e514a6d1da, user_id=d5fbf1acce354f52828bc69d79bdd9ae, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:40.702779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c9023-9c21-4580-85c1-8cd88fdeaa5e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:40.718894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1054/2078] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:40 2022] PUT /identity/v3/projects/9c1ba1a518e2430dbc5bd1e514a6d1da/users/d5fbf1acce354f52828bc69d79bdd9ae/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:40.723423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ae64-3037-4a53-9d07-5bda13d8bf65 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.733696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ae64-3037-4a53-9d07-5bda13d8bf65 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:40.787641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c9023-9c21-4580-85c1-8cd88fdeaa5e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.789764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b26c9023-9c21-4580-85c1-8cd88fdeaa5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:40.793549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077830f-c5a9-4d22-bf11-a19279cd51b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:40.795108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077830f-c5a9-4d22-bf11-a19279cd51b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.795921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077830f-c5a9-4d22-bf11-a19279cd51b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.796489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077830f-c5a9-4d22-bf11-a19279cd51b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.797506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077830f-c5a9-4d22-bf11-a19279cd51b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:40.799196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077830f-c5a9-4d22-bf11-a19279cd51b6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:40.813672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c9023-9c21-4580-85c1-8cd88fdeaa5e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:40.814372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1025/2079] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:40.818542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:40.819478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.819765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.820048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] PATH_INFO: `/v3/projects/63018953b0fc4dfdbd9744a4662d2883` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.821439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63018953b0fc4dfdbd9744a4662d2883)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:40.823495 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:40.825256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077830f-c5a9-4d22-bf11-a19279cd51b6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.838768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077830f-c5a9-4d22-bf11-a19279cd51b6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:40.843932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367411d-882a-48f6-b88f-da4935970b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:40.845535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367411d-882a-48f6-b88f-da4935970b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:40.845822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367411d-882a-48f6-b88f-da4935970b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:40.846116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367411d-882a-48f6-b88f-da4935970b84 admin admin] PATH_INFO: `/v3/projects/9c1ba1a518e2430dbc5bd1e514a6d1da/users/d5fbf1acce354f52828bc69d79bdd9ae/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:40.848199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367411d-882a-48f6-b88f-da4935970b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1ba1a518e2430dbc5bd1e514a6d1da, user_id=d5fbf1acce354f52828bc69d79bdd9ae, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:40.850935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367411d-882a-48f6-b88f-da4935970b84 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:40.865752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1026/2080] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:40 2022] PUT /identity/v3/projects/9c1ba1a518e2430dbc5bd1e514a6d1da/users/d5fbf1acce354f52828bc69d79bdd9ae/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:40.897196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63018953b0fc4dfdbd9744a4662d2883', 'request_id': 'req-22215125-f3fa-43a6-ba55-fb5bc4996b32'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.905036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63018953b0fc4dfdbd9744a4662d2883', 'request_id': 'req-22215125-f3fa-43a6-ba55-fb5bc4996b32'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.915209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63018953b0fc4dfdbd9744a4662d2883', 'request_id': 'req-22215125-f3fa-43a6-ba55-fb5bc4996b32'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.933600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] The token cache is being invalidate because project 63018953b0fc4dfdbd9744a4662d2883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:40.934398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.935418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:40.937463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1055/2081] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:40 2022] DELETE /identity/v3/projects/63018953b0fc4dfdbd9744a4662d2883 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:40.941639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367411d-882a-48f6-b88f-da4935970b84 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:40.943477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d367411d-882a-48f6-b88f-da4935970b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:41.006196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:41.025110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367411d-882a-48f6-b88f-da4935970b84 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:41.100558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:41.101514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:41.101794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:41.102292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] PATH_INFO: `/v3/users/27777d2181cd4d99846f214a79ee12a1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:41.103462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27777d2181cd4d99846f214a79ee12a1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:41.105359 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:41.170605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27777d2181cd4d99846f214a79ee12a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.171614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27777d2181cd4d99846f214a79ee12a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.172471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27777d2181cd4d99846f214a79ee12a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.215828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27777d2181cd4d99846f214a79ee12a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.225685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-faa6ed98-c2a0-4c56-9b80-1d42f9659711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27777d2181cd4d99846f214a79ee12a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.257961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1027/2082] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:40 2022] DELETE /identity/v3/users/27777d2181cd4d99846f214a79ee12a1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:41.618471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:41.624295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da7a85-11df-47c6-911e-eabf655a8f8b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:41.624741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da7a85-11df-47c6-911e-eabf655a8f8b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:41.625489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da7a85-11df-47c6-911e-eabf655a8f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:41.634987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22215125-f3fa-43a6-ba55-fb5bc4996b32 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:41.657349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:41.684180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-45da7a85-11df-47c6-911e-eabf655a8f8b None None] MFA Rules not processed for user `d5fbf1acce354f52828bc69d79bdd9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:41.689186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-45da7a85-11df-47c6-911e-eabf655a8f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:41.745134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:41.749001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:41.749569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:41.751343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] PATH_INFO: `/v3/projects/c89d259fd2a2483a9714d566fb319235` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:41.758395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89d259fd2a2483a9714d566fb319235)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:41.762345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:41.807551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:41.821027 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1028/2083] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:41.848216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89d259fd2a2483a9714d566fb319235', 'request_id': 'req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.857829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89d259fd2a2483a9714d566fb319235', 'request_id': 'req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.873465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89d259fd2a2483a9714d566fb319235', 'request_id': 'req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.907504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] The token cache is being invalidate because project c89d259fd2a2483a9714d566fb319235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:41.907934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.919860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b0c9b74-da88-4bae-adf7-d79b0a105f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:41.922714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1056/2084] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:41 2022] DELETE /identity/v3/projects/c89d259fd2a2483a9714d566fb319235 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:41.928555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d495855-c07a-47c8-bbac-1946cf15c413 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:41.929248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d495855-c07a-47c8-bbac-1946cf15c413 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:41.929719 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d495855-c07a-47c8-bbac-1946cf15c413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:41.956208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9d495855-c07a-47c8-bbac-1946cf15c413 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:41.958494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9d495855-c07a-47c8-bbac-1946cf15c413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:42.024315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1029/2085] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:42.033185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cfb98-ea2c-473d-93a4-d60bcf545057 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.033472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cfb98-ea2c-473d-93a4-d60bcf545057 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.033749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cfb98-ea2c-473d-93a4-d60bcf545057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.053475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-df4cfb98-ea2c-473d-93a4-d60bcf545057 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:42.054709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-df4cfb98-ea2c-473d-93a4-d60bcf545057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:42.062983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1057/2086] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:42.067533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d495855-c07a-47c8-bbac-1946cf15c413 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.078175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d495855-c07a-47c8-bbac-1946cf15c413 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.084022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d46b2-da34-475c-a15a-e46b77fd932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.084699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d46b2-da34-475c-a15a-e46b77fd932d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.085012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d46b2-da34-475c-a15a-e46b77fd932d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.085287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d46b2-da34-475c-a15a-e46b77fd932d admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.086081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d46b2-da34-475c-a15a-e46b77fd932d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:42.086411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d46b2-da34-475c-a15a-e46b77fd932d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.088044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d46b2-da34-475c-a15a-e46b77fd932d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.101575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1030/2087] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:42.106701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cfb98-ea2c-473d-93a4-d60bcf545057 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.116451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cfb98-ea2c-473d-93a4-d60bcf545057 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.121185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08307edf-a0c1-4734-9760-20bdf26e46e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.121844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08307edf-a0c1-4734-9760-20bdf26e46e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.122121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08307edf-a0c1-4734-9760-20bdf26e46e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.122392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08307edf-a0c1-4734-9760-20bdf26e46e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.123078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08307edf-a0c1-4734-9760-20bdf26e46e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.125317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08307edf-a0c1-4734-9760-20bdf26e46e5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.156523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1058/2088] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:42 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:42.157793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d46b2-da34-475c-a15a-e46b77fd932d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.168587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d46b2-da34-475c-a15a-e46b77fd932d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.232110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c349ff4-947b-45b9-8f19-df49d64e72eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.232811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c349ff4-947b-45b9-8f19-df49d64e72eb admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.233131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c349ff4-947b-45b9-8f19-df49d64e72eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.233411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c349ff4-947b-45b9-8f19-df49d64e72eb admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.234162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c349ff4-947b-45b9-8f19-df49d64e72eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.236117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c349ff4-947b-45b9-8f19-df49d64e72eb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.267493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1031/2089] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:42 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:42.271850 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08307edf-a0c1-4734-9760-20bdf26e46e5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.285690 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08307edf-a0c1-4734-9760-20bdf26e46e5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.291381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd3f6d-f606-4724-8ecd-752f0ab18b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.292541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd3f6d-f606-4724-8ecd-752f0ab18b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.293121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd3f6d-f606-4724-8ecd-752f0ab18b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.293868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd3f6d-f606-4724-8ecd-752f0ab18b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.294452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd3f6d-f606-4724-8ecd-752f0ab18b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.296243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd3f6d-f606-4724-8ecd-752f0ab18b51 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.307731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1059/2090] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:42.311624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c349ff4-947b-45b9-8f19-df49d64e72eb admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.323842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c349ff4-947b-45b9-8f19-df49d64e72eb admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.328976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dfdc7-604f-4eea-ad08-83cca02a6a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.329660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfdc7-604f-4eea-ad08-83cca02a6a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.329943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfdc7-604f-4eea-ad08-83cca02a6a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.330281 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfdc7-604f-4eea-ad08-83cca02a6a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.331121 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dfdc7-604f-4eea-ad08-83cca02a6a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.332639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dfdc7-604f-4eea-ad08-83cca02a6a94 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.343557 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1032/2091] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:42.348214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd3f6d-f606-4724-8ecd-752f0ab18b51 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.358465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd3f6d-f606-4724-8ecd-752f0ab18b51 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.363363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51c77-d89e-4176-a26a-6591f443ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.364367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51c77-d89e-4176-a26a-6591f443ee6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.364672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51c77-d89e-4176-a26a-6591f443ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.364987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51c77-d89e-4176-a26a-6591f443ee6b admin admin] PATH_INFO: `/v3/projects/04b54d53a80f4221a67aa25f2620f215/users/12aa30b5aea443bf88726a9d8c065b55/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.390941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e51c77-d89e-4176-a26a-6591f443ee6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b54d53a80f4221a67aa25f2620f215, user_id=12aa30b5aea443bf88726a9d8c065b55, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.393842 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e51c77-d89e-4176-a26a-6591f443ee6b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.409128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1060/2092] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:42 2022] PUT /identity/v3/projects/04b54d53a80f4221a67aa25f2620f215/users/12aa30b5aea443bf88726a9d8c065b55/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:42.421001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55210e34-02f0-4242-be66-ee4c5026b47c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.421437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55210e34-02f0-4242-be66-ee4c5026b47c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.421724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55210e34-02f0-4242-be66-ee4c5026b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.450028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-55210e34-02f0-4242-be66-ee4c5026b47c None None] MFA Rules not processed for user `12aa30b5aea443bf88726a9d8c065b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:42.451283 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-55210e34-02f0-4242-be66-ee4c5026b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:42.511816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:42.526272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1033/2093] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:42.527472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51c77-d89e-4176-a26a-6591f443ee6b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.572946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:42.600374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51c77-d89e-4176-a26a-6591f443ee6b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.605715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b10e8-72c9-4b79-9685-b43aea3e0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.606385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b10e8-72c9-4b79-9685-b43aea3e0a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.606662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b10e8-72c9-4b79-9685-b43aea3e0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.606930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b10e8-72c9-4b79-9685-b43aea3e0a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.607619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b10e8-72c9-4b79-9685-b43aea3e0a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.610039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b10e8-72c9-4b79-9685-b43aea3e0a69 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.646025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1061/2094] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:42 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:42.650138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55210e34-02f0-4242-be66-ee4c5026b47c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.661578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55210e34-02f0-4242-be66-ee4c5026b47c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.678723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642590-18d2-4a4d-b1d8-9e3975d6b0f5 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.679003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642590-18d2-4a4d-b1d8-9e3975d6b0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.679326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642590-18d2-4a4d-b1d8-9e3975d6b0f5 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.680744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1062/2095] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:31:42.699481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870e1b-f931-44df-afa2-69d4adef07ec None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.699971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870e1b-f931-44df-afa2-69d4adef07ec None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.700256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c870e1b-f931-44df-afa2-69d4adef07ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.719702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2c870e1b-f931-44df-afa2-69d4adef07ec None None] MFA Rules not processed for user `eb3ded7163fa400399d1b09079a366ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:42.720977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2c870e1b-f931-44df-afa2-69d4adef07ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:42.749326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95575baa-8378-402e-9fe3-608bde4b087c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.751200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95575baa-8378-402e-9fe3-608bde4b087c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.751717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95575baa-8378-402e-9fe3-608bde4b087c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.752428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95575baa-8378-402e-9fe3-608bde4b087c admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.753612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95575baa-8378-402e-9fe3-608bde4b087c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.755774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95575baa-8378-402e-9fe3-608bde4b087c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.791946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1034/2096] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:42 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:42.792431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95575baa-8378-402e-9fe3-608bde4b087c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.805673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95575baa-8378-402e-9fe3-608bde4b087c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.807839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1063/2097] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:31:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:42.810767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a0f79-0a3f-4abf-a0bb-439de815b1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.811449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a0f79-0a3f-4abf-a0bb-439de815b1dc admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.811786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a0f79-0a3f-4abf-a0bb-439de815b1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.812083 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a0f79-0a3f-4abf-a0bb-439de815b1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.812804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a0f79-0a3f-4abf-a0bb-439de815b1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.814494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a0f79-0a3f-4abf-a0bb-439de815b1dc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.819797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870e1b-f931-44df-afa2-69d4adef07ec None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.821629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2c870e1b-f931-44df-afa2-69d4adef07ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:42.826513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1035/2098] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:42.831106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a0f79-0a3f-4abf-a0bb-439de815b1dc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.840513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c870e1b-f931-44df-afa2-69d4adef07ec None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.848038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d638bf-4ae8-46d6-8176-b43cd411f827 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.848964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d638bf-4ae8-46d6-8176-b43cd411f827 service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.849322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d638bf-4ae8-46d6-8176-b43cd411f827 service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.849663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a0f79-0a3f-4abf-a0bb-439de815b1dc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:42.849790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d638bf-4ae8-46d6-8176-b43cd411f827 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.854703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63af0-63e7-4aca-bf92-726d5df572df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:42.855602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63af0-63e7-4aca-bf92-726d5df572df admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:42.855882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63af0-63e7-4aca-bf92-726d5df572df admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:42.856155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63af0-63e7-4aca-bf92-726d5df572df admin admin] PATH_INFO: `/v3/projects/5bfc76aff1f44b5d97b3c8e6411a546c/users/1cc9dac07cd14f588cd9701e886a7ab9/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:42.861322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d638bf-4ae8-46d6-8176-b43cd411f827 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.863018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d638bf-4ae8-46d6-8176-b43cd411f827 service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.876413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1064/2099] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:31:42.879002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba63af0-63e7-4aca-bf92-726d5df572df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfc76aff1f44b5d97b3c8e6411a546c, user_id=1cc9dac07cd14f588cd9701e886a7ab9, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:42.881774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba63af0-63e7-4aca-bf92-726d5df572df admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:42.924361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1036/2100] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:42 2022] PUT /identity/v3/projects/5bfc76aff1f44b5d97b3c8e6411a546c/users/1cc9dac07cd14f588cd9701e886a7ab9/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:42.925821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d638bf-4ae8-46d6-8176-b43cd411f827 service placement] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:42.942415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d638bf-4ae8-46d6-8176-b43cd411f827 service placement] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:43.056510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719dc0b-335d-4259-bb80-6d542c6131f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:43.057259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719dc0b-335d-4259-bb80-6d542c6131f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:43.057559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719dc0b-335d-4259-bb80-6d542c6131f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:43.057812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719dc0b-335d-4259-bb80-6d542c6131f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:43.058596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719dc0b-335d-4259-bb80-6d542c6131f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:43.060553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719dc0b-335d-4259-bb80-6d542c6131f0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:43.074386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1065/2101] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:43.078658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63af0-63e7-4aca-bf92-726d5df572df admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:43.089772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63af0-63e7-4aca-bf92-726d5df572df admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:43.095734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c58187-b3cf-4a8d-8e06-9ad7196706e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:43.096638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c58187-b3cf-4a8d-8e06-9ad7196706e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:43.096944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c58187-b3cf-4a8d-8e06-9ad7196706e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:43.097215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c58187-b3cf-4a8d-8e06-9ad7196706e0 admin admin] PATH_INFO: `/v3/projects/5bfc76aff1f44b5d97b3c8e6411a546c/users/1cc9dac07cd14f588cd9701e886a7ab9/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:43.099216 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c58187-b3cf-4a8d-8e06-9ad7196706e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfc76aff1f44b5d97b3c8e6411a546c, user_id=1cc9dac07cd14f588cd9701e886a7ab9, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:43.102025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c58187-b3cf-4a8d-8e06-9ad7196706e0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:43.113180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1037/2102] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:43 2022] PUT /identity/v3/projects/5bfc76aff1f44b5d97b3c8e6411a546c/users/1cc9dac07cd14f588cd9701e886a7ab9/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:43.124819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c422b-effa-4db5-aa21-8a2a9af1351e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:43.125140 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c422b-effa-4db5-aa21-8a2a9af1351e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:43.125417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c422b-effa-4db5-aa21-8a2a9af1351e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:43.154054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-002c422b-effa-4db5-aa21-8a2a9af1351e None None] MFA Rules not processed for user `1cc9dac07cd14f588cd9701e886a7ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:43.155266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-002c422b-effa-4db5-aa21-8a2a9af1351e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:43.198702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:43.236357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1066/2103] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:43.248124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c58187-b3cf-4a8d-8e06-9ad7196706e0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:43.250244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-88c58187-b3cf-4a8d-8e06-9ad7196706e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:43.314231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c58187-b3cf-4a8d-8e06-9ad7196706e0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:43.318102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c62b97-cbe7-4d6f-9f6f-7fd9bb907efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:43.318772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c62b97-cbe7-4d6f-9f6f-7fd9bb907efe service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:43.319086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c62b97-cbe7-4d6f-9f6f-7fd9bb907efe service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:43.319362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c62b97-cbe7-4d6f-9f6f-7fd9bb907efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:43.329124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c62b97-cbe7-4d6f-9f6f-7fd9bb907efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:43.330586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c62b97-cbe7-4d6f-9f6f-7fd9bb907efe service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:43.341533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1038/2104] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:43.463268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c422b-effa-4db5-aa21-8a2a9af1351e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:43.476876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c422b-effa-4db5-aa21-8a2a9af1351e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:43.481293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c62b97-cbe7-4d6f-9f6f-7fd9bb907efe service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:43.481902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d6aac-e167-432a-9853-372ed32dbd8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:43.482616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d6aac-e167-432a-9853-372ed32dbd8e service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:43.482961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d6aac-e167-432a-9853-372ed32dbd8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:43.483292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d6aac-e167-432a-9853-372ed32dbd8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:43.483862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-80c62b97-cbe7-4d6f-9f6f-7fd9bb907efe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:43.537070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:43.551755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d6aac-e167-432a-9853-372ed32dbd8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:43.553358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d6aac-e167-432a-9853-372ed32dbd8e service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:43.560096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c62b97-cbe7-4d6f-9f6f-7fd9bb907efe service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:43.562683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1067/2105] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:43.563495 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d6aac-e167-432a-9853-372ed32dbd8e service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:43.565089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:43.565340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-205d6aac-e167-432a-9853-372ed32dbd8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:43.566121 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:43.566466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:43.566804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] PATH_INFO: `/v3/users/547c76ec433a42cdb3d2b7a7f55856b0` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:43.568072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=547c76ec433a42cdb3d2b7a7f55856b0)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:43.570271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:43.576203 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d6aac-e167-432a-9853-372ed32dbd8e service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:43.581517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd3055-88b4-47ab-adf9-0e9857d16400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:43.582246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd3055-88b4-47ab-adf9-0e9857d16400 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:43.583126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd3055-88b4-47ab-adf9-0e9857d16400 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:43.583126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd3055-88b4-47ab-adf9-0e9857d16400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:43.585701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-42bd3055-88b4-47ab-adf9-0e9857d16400 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:43.632395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547c76ec433a42cdb3d2b7a7f55856b0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:43.633284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547c76ec433a42cdb3d2b7a7f55856b0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:43.633899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547c76ec433a42cdb3d2b7a7f55856b0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:43.649771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547c76ec433a42cdb3d2b7a7f55856b0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:43.657884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547c76ec433a42cdb3d2b7a7f55856b0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:43.666094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd3055-88b4-47ab-adf9-0e9857d16400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:43.667702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd3055-88b4-47ab-adf9-0e9857d16400 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:43.679823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1039/2106] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:43 2022] DELETE /identity/v3/users/547c76ec433a42cdb3d2b7a7f55856b0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:43.681021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1068/2107] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:43.933100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:43.935449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:44.043641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a83d9-39ce-4bea-93fe-dfb064c8d287 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:44.048632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:44.049742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:44.050029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:44.050307 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] PATH_INFO: `/v3/projects/5e9dcbd7ff1b46179cf0890a742ba54c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:44.051807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e9dcbd7ff1b46179cf0890a742ba54c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:44.053871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:44.106689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e9dcbd7ff1b46179cf0890a742ba54c', 'request_id': 'req-b001c04a-10a7-40a5-9778-e339a13918c7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.114045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e9dcbd7ff1b46179cf0890a742ba54c', 'request_id': 'req-b001c04a-10a7-40a5-9778-e339a13918c7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.117272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:44.124941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e9dcbd7ff1b46179cf0890a742ba54c', 'request_id': 'req-b001c04a-10a7-40a5-9778-e339a13918c7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.137630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] The token cache is being invalidate because project 5e9dcbd7ff1b46179cf0890a742ba54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:44.137919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.138545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.140133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1040/2108] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:43 2022] DELETE /identity/v3/projects/5e9dcbd7ff1b46179cf0890a742ba54c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:44.144217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd3055-88b4-47ab-adf9-0e9857d16400 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:44.155060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd3055-88b4-47ab-adf9-0e9857d16400 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:44.214367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:44.215291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:44.215575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:44.215850 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] PATH_INFO: `/v3/users/d5fbf1acce354f52828bc69d79bdd9ae` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:44.217139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fbf1acce354f52828bc69d79bdd9ae)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:44.219148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:44.222098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:44.275259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fbf1acce354f52828bc69d79bdd9ae'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.275916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fbf1acce354f52828bc69d79bdd9ae'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.285387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fbf1acce354f52828bc69d79bdd9ae'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.292451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fbf1acce354f52828bc69d79bdd9ae'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.293228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f52cab1e-07cf-4277-b72d-19a141cf9938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fbf1acce354f52828bc69d79bdd9ae'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.312735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1069/2109] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:44 2022] DELETE /identity/v3/users/d5fbf1acce354f52828bc69d79bdd9ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:44.499932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:44.501962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:44.515910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001c04a-10a7-40a5-9778-e339a13918c7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:44.574482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:44.575363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:44.575644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:44.575920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] PATH_INFO: `/v3/projects/9c1ba1a518e2430dbc5bd1e514a6d1da` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:44.577163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1ba1a518e2430dbc5bd1e514a6d1da)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:44.581852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:44.634496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1ba1a518e2430dbc5bd1e514a6d1da', 'request_id': 'req-4db29a87-60ca-46bb-8754-b88978b103a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.639947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1ba1a518e2430dbc5bd1e514a6d1da', 'request_id': 'req-4db29a87-60ca-46bb-8754-b88978b103a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.650611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1ba1a518e2430dbc5bd1e514a6d1da', 'request_id': 'req-4db29a87-60ca-46bb-8754-b88978b103a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.664187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] The token cache is being invalidate because project 9c1ba1a518e2430dbc5bd1e514a6d1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:44.664514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.665227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4db29a87-60ca-46bb-8754-b88978b103a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:44.666727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1041/2110] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:44 2022] DELETE /identity/v3/projects/9c1ba1a518e2430dbc5bd1e514a6d1da => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:44.672214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7095b1-b293-45ee-aac8-1ea19e76af3d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:44.672743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7095b1-b293-45ee-aac8-1ea19e76af3d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:44.672882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7095b1-b293-45ee-aac8-1ea19e76af3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:44.691574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ac7095b1-b293-45ee-aac8-1ea19e76af3d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:44.692802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ac7095b1-b293-45ee-aac8-1ea19e76af3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:44.761467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1070/2111] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:44.770673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491130f-9ccf-4fce-adf6-b234737db10a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:44.770961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491130f-9ccf-4fce-adf6-b234737db10a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:44.771264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491130f-9ccf-4fce-adf6-b234737db10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:44.790463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6491130f-9ccf-4fce-adf6-b234737db10a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:44.791596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6491130f-9ccf-4fce-adf6-b234737db10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:44.800711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1042/2112] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:44.805123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7095b1-b293-45ee-aac8-1ea19e76af3d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:44.815326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7095b1-b293-45ee-aac8-1ea19e76af3d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:44.820049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0c7b7-f83d-41a6-97a5-5cf835ec85c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:44.820718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0c7b7-f83d-41a6-97a5-5cf835ec85c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:44.821073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0c7b7-f83d-41a6-97a5-5cf835ec85c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:44.821329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0c7b7-f83d-41a6-97a5-5cf835ec85c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:44.822064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0c7b7-f83d-41a6-97a5-5cf835ec85c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:44.822370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0c7b7-f83d-41a6-97a5-5cf835ec85c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:44.823979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0c7b7-f83d-41a6-97a5-5cf835ec85c9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:44.837461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1071/2113] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:44.841735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491130f-9ccf-4fce-adf6-b234737db10a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:44.852233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491130f-9ccf-4fce-adf6-b234737db10a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:44.858135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a96f2-4343-4a92-a2f5-b195df0dbb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:44.858909 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a96f2-4343-4a92-a2f5-b195df0dbb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:44.859289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a96f2-4343-4a92-a2f5-b195df0dbb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:44.859668 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a96f2-4343-4a92-a2f5-b195df0dbb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:44.860464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a96f2-4343-4a92-a2f5-b195df0dbb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:44.867562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a96f2-4343-4a92-a2f5-b195df0dbb08 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:44.897430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1043/2114] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:44 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:44.901961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0c7b7-f83d-41a6-97a5-5cf835ec85c9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:44.912791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0c7b7-f83d-41a6-97a5-5cf835ec85c9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:44.987230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aadd3f-6a91-43f2-9f33-3108ca513f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:44.988011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aadd3f-6a91-43f2-9f33-3108ca513f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:44.988367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aadd3f-6a91-43f2-9f33-3108ca513f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:44.988704 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aadd3f-6a91-43f2-9f33-3108ca513f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:44.989441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aadd3f-6a91-43f2-9f33-3108ca513f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:44.992396 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aadd3f-6a91-43f2-9f33-3108ca513f22 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.011372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:45.022105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1072/2115] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:44 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:45.024108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a96f2-4343-4a92-a2f5-b195df0dbb08 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.038012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a96f2-4343-4a92-a2f5-b195df0dbb08 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.043829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4f39-40b7-44ed-a696-0c59701d2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.044512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4f39-40b7-44ed-a696-0c59701d2961 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.045050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4f39-40b7-44ed-a696-0c59701d2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.045244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4f39-40b7-44ed-a696-0c59701d2961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.046626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c4f39-40b7-44ed-a696-0c59701d2961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.048351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c4f39-40b7-44ed-a696-0c59701d2961 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.064680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1044/2116] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:45.065974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aadd3f-6a91-43f2-9f33-3108ca513f22 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.076130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aadd3f-6a91-43f2-9f33-3108ca513f22 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.081314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e58b-f40b-426e-94be-379349c20b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.081988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e58b-f40b-426e-94be-379349c20b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.082270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e58b-f40b-426e-94be-379349c20b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.082566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e58b-f40b-426e-94be-379349c20b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.083304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918e58b-f40b-426e-94be-379349c20b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.084915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918e58b-f40b-426e-94be-379349c20b56 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.097834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1073/2117] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:45.103277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4f39-40b7-44ed-a696-0c59701d2961 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.115257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4f39-40b7-44ed-a696-0c59701d2961 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.122036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a7335-09bd-44e6-aa72-fc27246e620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.123830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a7335-09bd-44e6-aa72-fc27246e620e admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.123830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a7335-09bd-44e6-aa72-fc27246e620e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.124057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a7335-09bd-44e6-aa72-fc27246e620e admin admin] PATH_INFO: `/v3/projects/15171a50fa6f44088e0cc1e0b9ce34a9/users/5a78d04f08cd4e1ebb163253636d942f/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.145874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a7335-09bd-44e6-aa72-fc27246e620e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15171a50fa6f44088e0cc1e0b9ce34a9, user_id=5a78d04f08cd4e1ebb163253636d942f, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.148660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a7335-09bd-44e6-aa72-fc27246e620e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.165300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1045/2118] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:45 2022] PUT /identity/v3/projects/15171a50fa6f44088e0cc1e0b9ce34a9/users/5a78d04f08cd4e1ebb163253636d942f/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:45.175994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40495052-4f0b-40ff-bb7d-d4610c1b7a99 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.176223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40495052-4f0b-40ff-bb7d-d4610c1b7a99 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.176492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40495052-4f0b-40ff-bb7d-d4610c1b7a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.209263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-40495052-4f0b-40ff-bb7d-d4610c1b7a99 None None] MFA Rules not processed for user `5a78d04f08cd4e1ebb163253636d942f`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:45.211159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-40495052-4f0b-40ff-bb7d-d4610c1b7a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:45.302466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1074/2119] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:45.307353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a7335-09bd-44e6-aa72-fc27246e620e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.326808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:45.377870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a7335-09bd-44e6-aa72-fc27246e620e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.382589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f101dab-a466-4089-94d0-61d4c3642b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.383316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f101dab-a466-4089-94d0-61d4c3642b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.383596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f101dab-a466-4089-94d0-61d4c3642b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.383863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f101dab-a466-4089-94d0-61d4c3642b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.384554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f101dab-a466-4089-94d0-61d4c3642b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.386588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f101dab-a466-4089-94d0-61d4c3642b21 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.420408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1046/2120] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:45 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:45.421701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40495052-4f0b-40ff-bb7d-d4610c1b7a99 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.432773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40495052-4f0b-40ff-bb7d-d4610c1b7a99 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.505947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9bf31-ea46-466a-8e0a-340c9fc19c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.506589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9bf31-ea46-466a-8e0a-340c9fc19c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.506868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9bf31-ea46-466a-8e0a-340c9fc19c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.507144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9bf31-ea46-466a-8e0a-340c9fc19c91 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.507837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9bf31-ea46-466a-8e0a-340c9fc19c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.509814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9bf31-ea46-466a-8e0a-340c9fc19c91 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.531771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1075/2121] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:45 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:45.535520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f101dab-a466-4089-94d0-61d4c3642b21 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.546526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f101dab-a466-4089-94d0-61d4c3642b21 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.551915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cde23-7d4c-4982-ba9c-950313b82c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.552603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cde23-7d4c-4982-ba9c-950313b82c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.552918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cde23-7d4c-4982-ba9c-950313b82c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.553198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cde23-7d4c-4982-ba9c-950313b82c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.553937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cde23-7d4c-4982-ba9c-950313b82c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.555600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cde23-7d4c-4982-ba9c-950313b82c12 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.570479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1047/2122] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:45.574609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9bf31-ea46-466a-8e0a-340c9fc19c91 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.585476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9bf31-ea46-466a-8e0a-340c9fc19c91 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.591803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5731db-4e0a-4745-8604-8c1b15f5805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.592806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5731db-4e0a-4745-8604-8c1b15f5805e admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.593239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5731db-4e0a-4745-8604-8c1b15f5805e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.593513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5731db-4e0a-4745-8604-8c1b15f5805e admin admin] PATH_INFO: `/v3/projects/577f3f3021f0428eb161e336c83af714/users/e644a08483e3482384c12e881050327b/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.609943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5731db-4e0a-4745-8604-8c1b15f5805e admin admin] RBAC: Authorizing `identity:create_grant(project_id=577f3f3021f0428eb161e336c83af714, user_id=e644a08483e3482384c12e881050327b, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.612623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5731db-4e0a-4745-8604-8c1b15f5805e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.628443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1076/2123] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:45 2022] PUT /identity/v3/projects/577f3f3021f0428eb161e336c83af714/users/e644a08483e3482384c12e881050327b/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:45.632614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cde23-7d4c-4982-ba9c-950313b82c12 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.643053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cde23-7d4c-4982-ba9c-950313b82c12 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.705188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ee776-11f8-4f5c-bc5f-301b5f8f1cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.705891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee776-11f8-4f5c-bc5f-301b5f8f1cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.706170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee776-11f8-4f5c-bc5f-301b5f8f1cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.706447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ee776-11f8-4f5c-bc5f-301b5f8f1cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.707193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ee776-11f8-4f5c-bc5f-301b5f8f1cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.708827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ee776-11f8-4f5c-bc5f-301b5f8f1cf4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.720285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1048/2124] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:45.724429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5731db-4e0a-4745-8604-8c1b15f5805e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.735346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5731db-4e0a-4745-8604-8c1b15f5805e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.740140 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5413af0-d35c-4586-809e-aa2b4adefcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.741069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5413af0-d35c-4586-809e-aa2b4adefcac admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.741346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5413af0-d35c-4586-809e-aa2b4adefcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.741619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5413af0-d35c-4586-809e-aa2b4adefcac admin admin] PATH_INFO: `/v3/projects/577f3f3021f0428eb161e336c83af714/users/e644a08483e3482384c12e881050327b/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.743574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5413af0-d35c-4586-809e-aa2b4adefcac admin admin] RBAC: Authorizing `identity:create_grant(project_id=577f3f3021f0428eb161e336c83af714, user_id=e644a08483e3482384c12e881050327b, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.746309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5413af0-d35c-4586-809e-aa2b4adefcac admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.757434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1077/2125] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:45 2022] PUT /identity/v3/projects/577f3f3021f0428eb161e336c83af714/users/e644a08483e3482384c12e881050327b/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:45.768834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba3098-ea95-46db-9648-220ca120a5bc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.769158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba3098-ea95-46db-9648-220ca120a5bc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.769437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba3098-ea95-46db-9648-220ca120a5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.798370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2aba3098-ea95-46db-9648-220ca120a5bc None None] MFA Rules not processed for user `e644a08483e3482384c12e881050327b`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:45.799608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2aba3098-ea95-46db-9648-220ca120a5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:45.872985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1049/2126] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:45.884371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5413af0-d35c-4586-809e-aa2b4adefcac admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:45.886068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d5413af0-d35c-4586-809e-aa2b4adefcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:45.920355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:45.947346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5413af0-d35c-4586-809e-aa2b4adefcac admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:45.951176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377bf4f-8b1c-4f59-b093-edf456319800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:45.951836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377bf4f-8b1c-4f59-b093-edf456319800 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:45.952115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377bf4f-8b1c-4f59-b093-edf456319800 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:45.952393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377bf4f-8b1c-4f59-b093-edf456319800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:45.961447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377bf4f-8b1c-4f59-b093-edf456319800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:45.962892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377bf4f-8b1c-4f59-b093-edf456319800 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:45.972707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1078/2127] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:46.003141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba3098-ea95-46db-9648-220ca120a5bc None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:46.017488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:46.071102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba3098-ea95-46db-9648-220ca120a5bc None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:46.075736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:46.076610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:46.076886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:46.077184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] PATH_INFO: `/v3/users/5a78d04f08cd4e1ebb163253636d942f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:46.078455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a78d04f08cd4e1ebb163253636d942f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:46.080577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:46.134451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a78d04f08cd4e1ebb163253636d942f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.135138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a78d04f08cd4e1ebb163253636d942f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.135748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a78d04f08cd4e1ebb163253636d942f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.147920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a78d04f08cd4e1ebb163253636d942f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.155036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a78d04f08cd4e1ebb163253636d942f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.169283 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1050/2128] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:46 2022] DELETE /identity/v3/users/5a78d04f08cd4e1ebb163253636d942f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:46.174013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310b7f-605d-41d9-a7d4-2fd210327022 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:46.174303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310b7f-605d-41d9-a7d4-2fd210327022 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:46.174577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310b7f-605d-41d9-a7d4-2fd210327022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:46.192374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9b310b7f-605d-41d9-a7d4-2fd210327022 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:46.193655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9b310b7f-605d-41d9-a7d4-2fd210327022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:46.264052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1079/2129] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:46.274085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:46.276131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:46.352930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15507dd8-3853-461d-b466-3d732d2edb5f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:46.357473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1991e8-2c91-499e-89fd-a74cfab6d731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:46.358277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1991e8-2c91-499e-89fd-a74cfab6d731 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:46.358625 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1991e8-2c91-499e-89fd-a74cfab6d731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:46.358964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1991e8-2c91-499e-89fd-a74cfab6d731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:46.373882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1991e8-2c91-499e-89fd-a74cfab6d731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:46.375672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1991e8-2c91-499e-89fd-a74cfab6d731 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:46.387906 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1051/2130] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:46.736449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310b7f-605d-41d9-a7d4-2fd210327022 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:46.738896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9b310b7f-605d-41d9-a7d4-2fd210327022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:46.758255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b310b7f-605d-41d9-a7d4-2fd210327022 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:46.779717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:46.780943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:46.781299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:46.781678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] PATH_INFO: `/v3/projects/15171a50fa6f44088e0cc1e0b9ce34a9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:46.783040 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15171a50fa6f44088e0cc1e0b9ce34a9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:46.793548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:46.848459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15171a50fa6f44088e0cc1e0b9ce34a9', 'request_id': 'req-6f660da8-d137-4957-acd6-368213ffcb3d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.854267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15171a50fa6f44088e0cc1e0b9ce34a9', 'request_id': 'req-6f660da8-d137-4957-acd6-368213ffcb3d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.865201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15171a50fa6f44088e0cc1e0b9ce34a9', 'request_id': 'req-6f660da8-d137-4957-acd6-368213ffcb3d'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.877287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] The token cache is being invalidate because project 15171a50fa6f44088e0cc1e0b9ce34a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:46.877574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.878213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:46.879942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1080/2131] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:46 2022] DELETE /identity/v3/projects/15171a50fa6f44088e0cc1e0b9ce34a9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:46.883796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1991e8-2c91-499e-89fd-a74cfab6d731 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:46.894310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1991e8-2c91-499e-89fd-a74cfab6d731 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:46.925291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:46.958777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:46.959672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:46.959967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:46.960247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] PATH_INFO: `/v3/users/e644a08483e3482384c12e881050327b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:46.961465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e644a08483e3482384c12e881050327b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:46.963430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:47.025771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e644a08483e3482384c12e881050327b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.026593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e644a08483e3482384c12e881050327b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.027493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e644a08483e3482384c12e881050327b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.041208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e644a08483e3482384c12e881050327b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.052933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-11b67981-5ac0-49d2-b4b7-64bdc44358a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e644a08483e3482384c12e881050327b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.067810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1052/2132] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:46 2022] DELETE /identity/v3/users/e644a08483e3482384c12e881050327b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:47.376234 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:47.378888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:47.400903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f660da8-d137-4957-acd6-368213ffcb3d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:47.519534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:47.528451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:47.529578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:47.529868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:47.530837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] PATH_INFO: `/v3/projects/577f3f3021f0428eb161e336c83af714` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:47.532393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] RBAC: Authorizing `identity:delete_project(project_id=577f3f3021f0428eb161e336c83af714)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:47.535385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:47.611406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '577f3f3021f0428eb161e336c83af714', 'request_id': 'req-5cd751b5-6658-46a9-9234-80516cc4448a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.617517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '577f3f3021f0428eb161e336c83af714', 'request_id': 'req-5cd751b5-6658-46a9-9234-80516cc4448a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.628405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '577f3f3021f0428eb161e336c83af714', 'request_id': 'req-5cd751b5-6658-46a9-9234-80516cc4448a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.645868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] The token cache is being invalidate because project 577f3f3021f0428eb161e336c83af714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:47.646157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.647017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5cd751b5-6658-46a9-9234-80516cc4448a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:47.648760 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1081/2133] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:47 2022] DELETE /identity/v3/projects/577f3f3021f0428eb161e336c83af714 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:47.654036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c062-59a3-4942-a6f4-843e25edc062 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:47.654399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c062-59a3-4942-a6f4-843e25edc062 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:47.654770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907c062-59a3-4942-a6f4-843e25edc062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:47.678219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8907c062-59a3-4942-a6f4-843e25edc062 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:47.679467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8907c062-59a3-4942-a6f4-843e25edc062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:47.754789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1053/2134] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:47.762734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b78dc-11d2-4299-a26c-4a86d38cfef6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:47.763222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b78dc-11d2-4299-a26c-4a86d38cfef6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:47.763335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b78dc-11d2-4299-a26c-4a86d38cfef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:47.782276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3e6b78dc-11d2-4299-a26c-4a86d38cfef6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:47.783692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3e6b78dc-11d2-4299-a26c-4a86d38cfef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:47.798665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1082/2135] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:47.802779 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c062-59a3-4942-a6f4-843e25edc062 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:47.815904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907c062-59a3-4942-a6f4-843e25edc062 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:47.820725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31550a-10af-4f7b-b582-53d78d5d5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:47.821475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31550a-10af-4f7b-b582-53d78d5d5b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:47.821763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31550a-10af-4f7b-b582-53d78d5d5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:47.822039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31550a-10af-4f7b-b582-53d78d5d5b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:47.822796 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31550a-10af-4f7b-b582-53d78d5d5b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:47.823115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31550a-10af-4f7b-b582-53d78d5d5b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:47.824738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31550a-10af-4f7b-b582-53d78d5d5b3f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:47.837321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1054/2136] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:47.841727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b78dc-11d2-4299-a26c-4a86d38cfef6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:47.853026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b78dc-11d2-4299-a26c-4a86d38cfef6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:47.858115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee45767-dace-4d5f-a12c-aae4ab0712fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:47.859078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee45767-dace-4d5f-a12c-aae4ab0712fc admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:47.859552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee45767-dace-4d5f-a12c-aae4ab0712fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:47.859901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee45767-dace-4d5f-a12c-aae4ab0712fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:47.860725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee45767-dace-4d5f-a12c-aae4ab0712fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:47.862767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee45767-dace-4d5f-a12c-aae4ab0712fc admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:47.893730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1083/2137] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:47 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:47.898007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31550a-10af-4f7b-b582-53d78d5d5b3f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:47.915355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31550a-10af-4f7b-b582-53d78d5d5b3f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:47.968416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:47.999608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a009f-b503-41fa-ae6b-ed8ec06b1000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:48.000317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a009f-b503-41fa-ae6b-ed8ec06b1000 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.000610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a009f-b503-41fa-ae6b-ed8ec06b1000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.001502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a009f-b503-41fa-ae6b-ed8ec06b1000 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.001982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a009f-b503-41fa-ae6b-ed8ec06b1000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:48.004133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a009f-b503-41fa-ae6b-ed8ec06b1000 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:48.060702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1055/2138] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:47 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:48.064658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee45767-dace-4d5f-a12c-aae4ab0712fc admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:48.075239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee45767-dace-4d5f-a12c-aae4ab0712fc admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:48.080111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a18bc-c6b5-4034-b9fb-0619f4eea3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:48.080890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a18bc-c6b5-4034-b9fb-0619f4eea3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.081276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a18bc-c6b5-4034-b9fb-0619f4eea3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.081619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a18bc-c6b5-4034-b9fb-0619f4eea3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.082429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a18bc-c6b5-4034-b9fb-0619f4eea3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:48.084155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a18bc-c6b5-4034-b9fb-0619f4eea3ce admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:48.096057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1084/2139] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:48.100005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a009f-b503-41fa-ae6b-ed8ec06b1000 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:48.110919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a009f-b503-41fa-ae6b-ed8ec06b1000 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:48.116103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a416b0-5937-4bd0-a9b7-2f537e4d5a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:48.116727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a416b0-5937-4bd0-a9b7-2f537e4d5a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.117003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a416b0-5937-4bd0-a9b7-2f537e4d5a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.117280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a416b0-5937-4bd0-a9b7-2f537e4d5a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.118080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a416b0-5937-4bd0-a9b7-2f537e4d5a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:48.119703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a416b0-5937-4bd0-a9b7-2f537e4d5a1b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:48.132895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1056/2140] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:48.135208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a18bc-c6b5-4034-b9fb-0619f4eea3ce admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:48.146756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a18bc-c6b5-4034-b9fb-0619f4eea3ce admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:48.152153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2472c3-77cb-4e2d-bdef-02801d0e0cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:48.153091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2472c3-77cb-4e2d-bdef-02801d0e0cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.153369 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2472c3-77cb-4e2d-bdef-02801d0e0cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.153640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2472c3-77cb-4e2d-bdef-02801d0e0cf4 admin admin] PATH_INFO: `/v3/projects/cbf7f7b67f01438bb033b6020bd5a733/users/57b39add51e449d88597469095aa94d7/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.170319 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2472c3-77cb-4e2d-bdef-02801d0e0cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf7f7b67f01438bb033b6020bd5a733, user_id=57b39add51e449d88597469095aa94d7, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:48.173378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2472c3-77cb-4e2d-bdef-02801d0e0cf4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:48.188986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1085/2141] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:48 2022] PUT /identity/v3/projects/cbf7f7b67f01438bb033b6020bd5a733/users/57b39add51e449d88597469095aa94d7/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:48.199722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fd22c-9a53-42cb-b992-c219d8e4759b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.200013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fd22c-9a53-42cb-b992-c219d8e4759b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.200335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376fd22c-9a53-42cb-b992-c219d8e4759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.234010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-376fd22c-9a53-42cb-b992-c219d8e4759b None None] MFA Rules not processed for user `57b39add51e449d88597469095aa94d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:48.236143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-376fd22c-9a53-42cb-b992-c219d8e4759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:48.310523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1057/2142] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:48.321988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2472c3-77cb-4e2d-bdef-02801d0e0cf4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:48.323814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fb2472c3-77cb-4e2d-bdef-02801d0e0cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:48.390934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2472c3-77cb-4e2d-bdef-02801d0e0cf4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:48.395067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1540c6-e3dc-475f-9bf4-41eeccc55913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:48.395718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1540c6-e3dc-475f-9bf4-41eeccc55913 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.395995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1540c6-e3dc-475f-9bf4-41eeccc55913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.396268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1540c6-e3dc-475f-9bf4-41eeccc55913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.405865 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1540c6-e3dc-475f-9bf4-41eeccc55913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:48.408102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1540c6-e3dc-475f-9bf4-41eeccc55913 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:48.422163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1086/2143] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:48.441987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fd22c-9a53-42cb-b992-c219d8e4759b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:48.512866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376fd22c-9a53-42cb-b992-c219d8e4759b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:48.518873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:48.519963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.520257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.520667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] PATH_INFO: `/v3/users/57b39add51e449d88597469095aa94d7` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.522023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b39add51e449d88597469095aa94d7)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:48.524019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:48.577404 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b39add51e449d88597469095aa94d7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:48.577987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b39add51e449d88597469095aa94d7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:48.578590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b39add51e449d88597469095aa94d7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:48.580726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:48.593139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b39add51e449d88597469095aa94d7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:48.600318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b39add51e449d88597469095aa94d7'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:48.615323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1058/2144] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:48 2022] DELETE /identity/v3/users/57b39add51e449d88597469095aa94d7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:48.620085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466128c0-923a-4d3b-b876-643fb3cc3def None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.620364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466128c0-923a-4d3b-b876-643fb3cc3def None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.621281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466128c0-923a-4d3b-b876-643fb3cc3def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.639663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-466128c0-923a-4d3b-b876-643fb3cc3def None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:48.640860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-466128c0-923a-4d3b-b876-643fb3cc3def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:48.667723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:48.724857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1087/2145] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:48.734783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:48.737587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:48.805119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a099e-2d88-443e-aff3-25edf2e35e43 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:48.815585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea152e-9da7-4659-80ed-dc8a3e6cc8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:48.816338 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea152e-9da7-4659-80ed-dc8a3e6cc8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.816608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea152e-9da7-4659-80ed-dc8a3e6cc8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.817443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea152e-9da7-4659-80ed-dc8a3e6cc8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.829004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea152e-9da7-4659-80ed-dc8a3e6cc8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:48.830967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea152e-9da7-4659-80ed-dc8a3e6cc8b3 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:48.845328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1059/2146] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:48.949827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466128c0-923a-4d3b-b876-643fb3cc3def None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:48.951399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-466128c0-923a-4d3b-b876-643fb3cc3def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:48.964918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466128c0-923a-4d3b-b876-643fb3cc3def None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:48.977055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:48.978038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:48.978525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:48.978866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] PATH_INFO: `/v3/users/12aa30b5aea443bf88726a9d8c065b55` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:48.980468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=12aa30b5aea443bf88726a9d8c065b55)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:48.983677 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:49.076891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12aa30b5aea443bf88726a9d8c065b55'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.077651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12aa30b5aea443bf88726a9d8c065b55'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.099025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12aa30b5aea443bf88726a9d8c065b55'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.109876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12aa30b5aea443bf88726a9d8c065b55'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.111528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12aa30b5aea443bf88726a9d8c065b55'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.148312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1088/2147] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:48 2022] DELETE /identity/v3/users/12aa30b5aea443bf88726a9d8c065b55 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:49.150099 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232e810-d57b-4a23-9a42-c2da452d0b6f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.150562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232e810-d57b-4a23-9a42-c2da452d0b6f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.150653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232e810-d57b-4a23-9a42-c2da452d0b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.170927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8232e810-d57b-4a23-9a42-c2da452d0b6f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:49.180685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8232e810-d57b-4a23-9a42-c2da452d0b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:49.282519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1060/2148] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:49.283746 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:49.285217 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:49.295238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232e810-d57b-4a23-9a42-c2da452d0b6f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:49.297633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8232e810-d57b-4a23-9a42-c2da452d0b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:49.303264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68eb07-1617-4a60-a149-bc1a608fc6bd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:49.309635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:49.310724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.311041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.311390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] PATH_INFO: `/v3/projects/cbf7f7b67f01438bb033b6020bd5a733` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.312778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf7f7b67f01438bb033b6020bd5a733)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:49.314792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:49.361972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232e810-d57b-4a23-9a42-c2da452d0b6f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:49.364834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf7f7b67f01438bb033b6020bd5a733', 'request_id': 'req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.370406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf7f7b67f01438bb033b6020bd5a733', 'request_id': 'req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.378813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf7f7b67f01438bb033b6020bd5a733', 'request_id': 'req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.386475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:49.391886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] The token cache is being invalidate because project cbf7f7b67f01438bb033b6020bd5a733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:49.392174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.392885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d1d31136-2dde-4f6a-b0e0-f3e4ce5fc0a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:49.394558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1089/2149] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:49 2022] DELETE /identity/v3/projects/cbf7f7b67f01438bb033b6020bd5a733 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:49.399341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb9099-4e2d-4a97-a149-ca473a109b70 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.399635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb9099-4e2d-4a97-a149-ca473a109b70 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.399912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb9099-4e2d-4a97-a149-ca473a109b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.414712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567ee90-2a85-48ac-9be4-31b3f8247a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:49.415397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567ee90-2a85-48ac-9be4-31b3f8247a4d service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.415677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567ee90-2a85-48ac-9be4-31b3f8247a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.415951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567ee90-2a85-48ac-9be4-31b3f8247a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.417875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a567ee90-2a85-48ac-9be4-31b3f8247a4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:49.418111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-32cb9099-4e2d-4a97-a149-ca473a109b70 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:49.419296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-32cb9099-4e2d-4a97-a149-ca473a109b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:49.432211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:49.482784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1090/2150] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:49.484801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567ee90-2a85-48ac-9be4-31b3f8247a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:49.486350 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567ee90-2a85-48ac-9be4-31b3f8247a4d service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:49.490037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00c00a-0487-464c-89a7-782acd86ca6d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.490333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00c00a-0487-464c-89a7-782acd86ca6d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.490614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d00c00a-0487-464c-89a7-782acd86ca6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.496252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1061/2151] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:49.508697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0d00c00a-0487-464c-89a7-782acd86ca6d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:49.509950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0d00c00a-0487-464c-89a7-782acd86ca6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:49.518788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1091/2152] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:49.524417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567ee90-2a85-48ac-9be4-31b3f8247a4d service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:49.534410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567ee90-2a85-48ac-9be4-31b3f8247a4d service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:49.539209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad299e0-f0b6-4a1b-aaab-d74905d5db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:49.539912 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad299e0-f0b6-4a1b-aaab-d74905d5db86 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.540206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad299e0-f0b6-4a1b-aaab-d74905d5db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.540481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad299e0-f0b6-4a1b-aaab-d74905d5db86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.541309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad299e0-f0b6-4a1b-aaab-d74905d5db86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:49.541626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad299e0-f0b6-4a1b-aaab-d74905d5db86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:49.543262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad299e0-f0b6-4a1b-aaab-d74905d5db86 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:49.559324 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1062/2153] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:49.560577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00c00a-0487-464c-89a7-782acd86ca6d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:49.570424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d00c00a-0487-464c-89a7-782acd86ca6d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:49.575142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc65d5-b887-46dd-abeb-76769a776935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:49.576254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc65d5-b887-46dd-abeb-76769a776935 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.576531 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc65d5-b887-46dd-abeb-76769a776935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.576798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc65d5-b887-46dd-abeb-76769a776935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.577619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc65d5-b887-46dd-abeb-76769a776935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:49.579652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc65d5-b887-46dd-abeb-76769a776935 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:49.609551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1092/2154] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:49 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:49.614170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad299e0-f0b6-4a1b-aaab-d74905d5db86 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:49.625087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad299e0-f0b6-4a1b-aaab-d74905d5db86 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:49.689827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97cb4-62c4-4ad9-a488-2b9f1593c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:49.690529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97cb4-62c4-4ad9-a488-2b9f1593c22f admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.690816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97cb4-62c4-4ad9-a488-2b9f1593c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.691099 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97cb4-62c4-4ad9-a488-2b9f1593c22f admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.691817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a97cb4-62c4-4ad9-a488-2b9f1593c22f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:49.693855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a97cb4-62c4-4ad9-a488-2b9f1593c22f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:49.718752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1063/2155] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:49 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:49.723590 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc65d5-b887-46dd-abeb-76769a776935 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:49.736912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc65d5-b887-46dd-abeb-76769a776935 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:49.749514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400f297-ff07-4c6c-be88-8c2b4b78f283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:49.749514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f297-ff07-4c6c-be88-8c2b4b78f283 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.749514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f297-ff07-4c6c-be88-8c2b4b78f283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.749514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f297-ff07-4c6c-be88-8c2b4b78f283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.750025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400f297-ff07-4c6c-be88-8c2b4b78f283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:49.750025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400f297-ff07-4c6c-be88-8c2b4b78f283 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:49.759533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1093/2156] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:49.763931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97cb4-62c4-4ad9-a488-2b9f1593c22f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:49.776376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a97cb4-62c4-4ad9-a488-2b9f1593c22f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:49.781882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff044f7-89bf-4351-a227-ffba3a6afd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:49.782590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff044f7-89bf-4351-a227-ffba3a6afd80 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.782876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff044f7-89bf-4351-a227-ffba3a6afd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.783153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff044f7-89bf-4351-a227-ffba3a6afd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.783879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff044f7-89bf-4351-a227-ffba3a6afd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:49.785556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff044f7-89bf-4351-a227-ffba3a6afd80 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:49.796043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1064/2157] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:49.800745 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400f297-ff07-4c6c-be88-8c2b4b78f283 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:49.811304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400f297-ff07-4c6c-be88-8c2b4b78f283 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:49.817283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db07e-1b07-4d8b-9ea4-ea0f64a536a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:49.818210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db07e-1b07-4d8b-9ea4-ea0f64a536a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.818488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db07e-1b07-4d8b-9ea4-ea0f64a536a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.818761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db07e-1b07-4d8b-9ea4-ea0f64a536a4 admin admin] PATH_INFO: `/v3/projects/8d309222a3104db18c849c00e23b7247/users/22db980cea294e3ea9db21a27063c8fd/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.840013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0db07e-1b07-4d8b-9ea4-ea0f64a536a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d309222a3104db18c849c00e23b7247, user_id=22db980cea294e3ea9db21a27063c8fd, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:49.842821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0db07e-1b07-4d8b-9ea4-ea0f64a536a4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:49.859678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1094/2158] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:49 2022] PUT /identity/v3/projects/8d309222a3104db18c849c00e23b7247/users/22db980cea294e3ea9db21a27063c8fd/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:49.874944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf04d7-c8b2-4b84-bba5-c4e894a4f332 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:49.875240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf04d7-c8b2-4b84-bba5-c4e894a4f332 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:49.875524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcf04d7-c8b2-4b84-bba5-c4e894a4f332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:49.905050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5bcf04d7-c8b2-4b84-bba5-c4e894a4f332 None None] MFA Rules not processed for user `22db980cea294e3ea9db21a27063c8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:49.906288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5bcf04d7-c8b2-4b84-bba5-c4e894a4f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:49.937089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:49.980309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1065/2159] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:49.991609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db07e-1b07-4d8b-9ea4-ea0f64a536a4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:49.993457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5b0db07e-1b07-4d8b-9ea4-ea0f64a536a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:50.019771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf04d7-c8b2-4b84-bba5-c4e894a4f332 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:50.021251 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5bcf04d7-c8b2-4b84-bba5-c4e894a4f332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:50.059028 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db07e-1b07-4d8b-9ea4-ea0f64a536a4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:50.062832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5282de-762a-43a8-afde-a65fcdc5b11f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:50.063479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5282de-762a-43a8-afde-a65fcdc5b11f service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:50.063836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5282de-762a-43a8-afde-a65fcdc5b11f service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:50.064112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5282de-762a-43a8-afde-a65fcdc5b11f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:50.073088 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5282de-762a-43a8-afde-a65fcdc5b11f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:50.074528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5282de-762a-43a8-afde-a65fcdc5b11f service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:50.083879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1095/2160] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:50.088332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcf04d7-c8b2-4b84-bba5-c4e894a4f332 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:50.093301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:50.094531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:50.094896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:50.095181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] PATH_INFO: `/v3/projects/04b54d53a80f4221a67aa25f2620f215` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:50.096396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b54d53a80f4221a67aa25f2620f215)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:50.098360 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:50.158476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b54d53a80f4221a67aa25f2620f215', 'request_id': 'req-eb6fba7c-4786-49c8-8ada-98c053b03100'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.164568 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b54d53a80f4221a67aa25f2620f215', 'request_id': 'req-eb6fba7c-4786-49c8-8ada-98c053b03100'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.177194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b54d53a80f4221a67aa25f2620f215', 'request_id': 'req-eb6fba7c-4786-49c8-8ada-98c053b03100'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.189610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] The token cache is being invalidate because project 04b54d53a80f4221a67aa25f2620f215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:50.189901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.190569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.192152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1066/2161] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:50 2022] DELETE /identity/v3/projects/04b54d53a80f4221a67aa25f2620f215 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:31:50.196151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5282de-762a-43a8-afde-a65fcdc5b11f service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:50.206995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5282de-762a-43a8-afde-a65fcdc5b11f service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:50.278665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:50.278665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:50.279191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:50.279191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] PATH_INFO: `/v3/users/1cc9dac07cd14f588cd9701e886a7ab9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:50.281033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc9dac07cd14f588cd9701e886a7ab9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:50.283089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:50.287476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:50.349280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc9dac07cd14f588cd9701e886a7ab9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.351486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc9dac07cd14f588cd9701e886a7ab9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.366339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc9dac07cd14f588cd9701e886a7ab9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.375572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc9dac07cd14f588cd9701e886a7ab9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.376642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40db9ce9-d2fd-4bfb-b46a-b344f50d5544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc9dac07cd14f588cd9701e886a7ab9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.400645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1096/2162] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:50 2022] DELETE /identity/v3/users/1cc9dac07cd14f588cd9701e886a7ab9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:50.741649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:50.741649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:50.754427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fba7c-4786-49c8-8ada-98c053b03100 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:50.814772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:50.815780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:50.816066 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:50.816343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] PATH_INFO: `/v3/projects/5bfc76aff1f44b5d97b3c8e6411a546c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:50.817609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfc76aff1f44b5d97b3c8e6411a546c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:50.819538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:50.821870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:50.871114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfc76aff1f44b5d97b3c8e6411a546c', 'request_id': 'req-9095b8e2-a860-4bee-9cba-3b26d6466386'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.877104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfc76aff1f44b5d97b3c8e6411a546c', 'request_id': 'req-9095b8e2-a860-4bee-9cba-3b26d6466386'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.886255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfc76aff1f44b5d97b3c8e6411a546c', 'request_id': 'req-9095b8e2-a860-4bee-9cba-3b26d6466386'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.897820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] The token cache is being invalidate because project 5bfc76aff1f44b5d97b3c8e6411a546c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:50.898191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.898808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9095b8e2-a860-4bee-9cba-3b26d6466386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:50.900547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1067/2163] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:50 2022] DELETE /identity/v3/projects/5bfc76aff1f44b5d97b3c8e6411a546c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:50.905625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65620e-d919-4996-a6db-7162f8c33d14 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:50.905851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65620e-d919-4996-a6db-7162f8c33d14 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:50.906129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65620e-d919-4996-a6db-7162f8c33d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:50.924368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7b65620e-d919-4996-a6db-7162f8c33d14 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:50.925589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7b65620e-d919-4996-a6db-7162f8c33d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:50.986732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1097/2164] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:50.994768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f801-ed30-4694-9fcc-6d8d45bc60ad None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:50.995084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f801-ed30-4694-9fcc-6d8d45bc60ad None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:50.995366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f801-ed30-4694-9fcc-6d8d45bc60ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.014274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-07e1f801-ed30-4694-9fcc-6d8d45bc60ad None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:51.015485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-07e1f801-ed30-4694-9fcc-6d8d45bc60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:51.024240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1068/2165] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:51.028769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65620e-d919-4996-a6db-7162f8c33d14 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.038875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65620e-d919-4996-a6db-7162f8c33d14 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.043824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb943b-6197-4f2b-8b84-a199f0e7d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.044490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb943b-6197-4f2b-8b84-a199f0e7d658 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.044772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb943b-6197-4f2b-8b84-a199f0e7d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.045084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb943b-6197-4f2b-8b84-a199f0e7d658 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.045824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb943b-6197-4f2b-8b84-a199f0e7d658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:51.046131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb943b-6197-4f2b-8b84-a199f0e7d658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.047762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb943b-6197-4f2b-8b84-a199f0e7d658 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.060510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1098/2166] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:51.065545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f801-ed30-4694-9fcc-6d8d45bc60ad None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.075573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1f801-ed30-4694-9fcc-6d8d45bc60ad None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.080652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d403b-f79b-41ad-bf2f-75f8f1cf4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.081353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d403b-f79b-41ad-bf2f-75f8f1cf4208 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.081636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d403b-f79b-41ad-bf2f-75f8f1cf4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.081914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d403b-f79b-41ad-bf2f-75f8f1cf4208 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.082621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d403b-f79b-41ad-bf2f-75f8f1cf4208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.084555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d403b-f79b-41ad-bf2f-75f8f1cf4208 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.116808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1069/2167] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:51 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:51.121397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb943b-6197-4f2b-8b84-a199f0e7d658 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.131547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb943b-6197-4f2b-8b84-a199f0e7d658 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.192971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6f0a3-235e-472d-8113-1dc57e7a52f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.193650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6f0a3-235e-472d-8113-1dc57e7a52f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.193927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6f0a3-235e-472d-8113-1dc57e7a52f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.194199 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6f0a3-235e-472d-8113-1dc57e7a52f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.194895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6f0a3-235e-472d-8113-1dc57e7a52f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.196812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6f0a3-235e-472d-8113-1dc57e7a52f0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.207857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:51.220477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1099/2168] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:51 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:51.224611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d403b-f79b-41ad-bf2f-75f8f1cf4208 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.235102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d403b-f79b-41ad-bf2f-75f8f1cf4208 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.240461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0f691-2c98-4928-b541-3272544f74c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.241339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f691-2c98-4928-b541-3272544f74c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.241692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f691-2c98-4928-b541-3272544f74c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.242042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb0f691-2c98-4928-b541-3272544f74c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.243047 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0f691-2c98-4928-b541-3272544f74c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.244662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb0f691-2c98-4928-b541-3272544f74c0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.255156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1070/2169] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:51.259148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6f0a3-235e-472d-8113-1dc57e7a52f0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.269463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6f0a3-235e-472d-8113-1dc57e7a52f0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.274716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ab18-a33c-449f-a2a9-72fadcd0c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.275488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ab18-a33c-449f-a2a9-72fadcd0c155 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.275773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ab18-a33c-449f-a2a9-72fadcd0c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.276050 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ab18-a33c-449f-a2a9-72fadcd0c155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.276941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46ab18-a33c-449f-a2a9-72fadcd0c155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.278760 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46ab18-a33c-449f-a2a9-72fadcd0c155 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.290722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1100/2170] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:51.295012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0f691-2c98-4928-b541-3272544f74c0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.305489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb0f691-2c98-4928-b541-3272544f74c0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.310513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098fe18-b477-417a-8712-213a11ca55af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.311436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098fe18-b477-417a-8712-213a11ca55af admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.311718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098fe18-b477-417a-8712-213a11ca55af admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.312000 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098fe18-b477-417a-8712-213a11ca55af admin admin] PATH_INFO: `/v3/projects/3a719c1a28a64ad79ae87d1b23a2364c/users/8d693f5b55bb4066b3a0d14a3aef2092/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.328554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098fe18-b477-417a-8712-213a11ca55af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a719c1a28a64ad79ae87d1b23a2364c, user_id=8d693f5b55bb4066b3a0d14a3aef2092, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.331425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098fe18-b477-417a-8712-213a11ca55af admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.346494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1071/2171] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:51 2022] PUT /identity/v3/projects/3a719c1a28a64ad79ae87d1b23a2364c/users/8d693f5b55bb4066b3a0d14a3aef2092/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:51.357647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91fa90-001d-4c02-8406-860c019f232d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.357965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91fa90-001d-4c02-8406-860c019f232d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.358293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91fa90-001d-4c02-8406-860c019f232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.385702 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-db91fa90-001d-4c02-8406-860c019f232d None None] MFA Rules not processed for user `8d693f5b55bb4066b3a0d14a3aef2092`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:51.386921 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-db91fa90-001d-4c02-8406-860c019f232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:51.459900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1101/2172] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:51.465202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098fe18-b477-417a-8712-213a11ca55af admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.545906 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098fe18-b477-417a-8712-213a11ca55af admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.556558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7563db9-c62a-4546-aa2e-111462e94982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.557445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7563db9-c62a-4546-aa2e-111462e94982 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.557729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7563db9-c62a-4546-aa2e-111462e94982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.558002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7563db9-c62a-4546-aa2e-111462e94982 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.558707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7563db9-c62a-4546-aa2e-111462e94982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.563040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7563db9-c62a-4546-aa2e-111462e94982 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.596597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1072/2173] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:51 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:51.601284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91fa90-001d-4c02-8406-860c019f232d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.621238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91fa90-001d-4c02-8406-860c019f232d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.715057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e249-2a43-4687-8201-682080cf653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.715942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e249-2a43-4687-8201-682080cf653c admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.716228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e249-2a43-4687-8201-682080cf653c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.716552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e249-2a43-4687-8201-682080cf653c admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.717338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5e249-2a43-4687-8201-682080cf653c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.720010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5e249-2a43-4687-8201-682080cf653c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.744350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1102/2174] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:51 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:51.752883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7563db9-c62a-4546-aa2e-111462e94982 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.764703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7563db9-c62a-4546-aa2e-111462e94982 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.769658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34491e9a-aa06-4be0-9223-82a08a419484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.770342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34491e9a-aa06-4be0-9223-82a08a419484 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.770625 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34491e9a-aa06-4be0-9223-82a08a419484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.770903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34491e9a-aa06-4be0-9223-82a08a419484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.771643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34491e9a-aa06-4be0-9223-82a08a419484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.773777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34491e9a-aa06-4be0-9223-82a08a419484 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.785289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1073/2175] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:51.790361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e249-2a43-4687-8201-682080cf653c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.805316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e249-2a43-4687-8201-682080cf653c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.810782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c05b29-22e0-49e6-8a79-b8fb973fe087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.811688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c05b29-22e0-49e6-8a79-b8fb973fe087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.811968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c05b29-22e0-49e6-8a79-b8fb973fe087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.812245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c05b29-22e0-49e6-8a79-b8fb973fe087 admin admin] PATH_INFO: `/v3/projects/9a7ba29f2aa748c5939d970822491b81/users/54592c76aadf47e5a1bf73dd9f867156/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.835108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c05b29-22e0-49e6-8a79-b8fb973fe087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7ba29f2aa748c5939d970822491b81, user_id=54592c76aadf47e5a1bf73dd9f867156, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.838192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c05b29-22e0-49e6-8a79-b8fb973fe087 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.858827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1103/2176] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:51 2022] PUT /identity/v3/projects/9a7ba29f2aa748c5939d970822491b81/users/54592c76aadf47e5a1bf73dd9f867156/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:51.863380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34491e9a-aa06-4be0-9223-82a08a419484 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:51.873374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:51.879176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34491e9a-aa06-4be0-9223-82a08a419484 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:51.961898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17101195-a8c9-43fc-b4cd-a7ea9ad992d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:51.962545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17101195-a8c9-43fc-b4cd-a7ea9ad992d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:51.963264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17101195-a8c9-43fc-b4cd-a7ea9ad992d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:51.963581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17101195-a8c9-43fc-b4cd-a7ea9ad992d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:51.964370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17101195-a8c9-43fc-b4cd-a7ea9ad992d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:51.966167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17101195-a8c9-43fc-b4cd-a7ea9ad992d8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:51.989674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1074/2177] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:51.998433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c05b29-22e0-49e6-8a79-b8fb973fe087 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:52.011527 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c05b29-22e0-49e6-8a79-b8fb973fe087 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:52.016976 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709bd4-9b4c-480b-baad-af9772d06c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:52.017873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709bd4-9b4c-480b-baad-af9772d06c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:52.018154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709bd4-9b4c-480b-baad-af9772d06c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:52.018424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74709bd4-9b4c-480b-baad-af9772d06c15 admin admin] PATH_INFO: `/v3/projects/9a7ba29f2aa748c5939d970822491b81/users/54592c76aadf47e5a1bf73dd9f867156/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:52.020613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74709bd4-9b4c-480b-baad-af9772d06c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a7ba29f2aa748c5939d970822491b81, user_id=54592c76aadf47e5a1bf73dd9f867156, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:52.023620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74709bd4-9b4c-480b-baad-af9772d06c15 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:52.038331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1104/2178] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:51 2022] PUT /identity/v3/projects/9a7ba29f2aa748c5939d970822491b81/users/54592c76aadf47e5a1bf73dd9f867156/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:52.048550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee34f08-f471-43c7-a04b-540da87292a3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:52.048837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee34f08-f471-43c7-a04b-540da87292a3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:52.049145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee34f08-f471-43c7-a04b-540da87292a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:52.077383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1ee34f08-f471-43c7-a04b-540da87292a3 None None] MFA Rules not processed for user `54592c76aadf47e5a1bf73dd9f867156`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:52.078657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1ee34f08-f471-43c7-a04b-540da87292a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:52.149511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1075/2179] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:52.163129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709bd4-9b4c-480b-baad-af9772d06c15 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:52.165049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-74709bd4-9b4c-480b-baad-af9772d06c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:52.198038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:52.228141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74709bd4-9b4c-480b-baad-af9772d06c15 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:52.231770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6479bf-3177-4ef3-9331-3a5bfce1afe3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:52.232418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6479bf-3177-4ef3-9331-3a5bfce1afe3 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:52.232694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6479bf-3177-4ef3-9331-3a5bfce1afe3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:52.232995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6479bf-3177-4ef3-9331-3a5bfce1afe3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:52.295340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6479bf-3177-4ef3-9331-3a5bfce1afe3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:52.297065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6479bf-3177-4ef3-9331-3a5bfce1afe3 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:52.313945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1105/2180] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:53.373287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee34f08-f471-43c7-a04b-540da87292a3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:53.374731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1ee34f08-f471-43c7-a04b-540da87292a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:53.440000 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee34f08-f471-43c7-a04b-540da87292a3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:53.444911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:53.445830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:53.446117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:53.446392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] PATH_INFO: `/v3/users/22db980cea294e3ea9db21a27063c8fd` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:53.447660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22db980cea294e3ea9db21a27063c8fd)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:53.449886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:53.480274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:53.506287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22db980cea294e3ea9db21a27063c8fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:53.506941 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22db980cea294e3ea9db21a27063c8fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:53.507551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22db980cea294e3ea9db21a27063c8fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:53.522810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22db980cea294e3ea9db21a27063c8fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:53.530862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22db980cea294e3ea9db21a27063c8fd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:53.545038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1076/2181] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:53 2022] DELETE /identity/v3/users/22db980cea294e3ea9db21a27063c8fd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:53.549713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af471f-a6d0-4452-a582-4555bc3e9cc7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:53.550185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af471f-a6d0-4452-a582-4555bc3e9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:53.550300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af471f-a6d0-4452-a582-4555bc3e9cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:53.568162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d5af471f-a6d0-4452-a582-4555bc3e9cc7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:53.569462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d5af471f-a6d0-4452-a582-4555bc3e9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:53.632784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1106/2182] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:53.642917 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:53.644757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:53.708665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69478720-8f5e-4c6c-8a74-0834ff0d2b85 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:53.712623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994132d7-5c95-427e-a440-3a99a24b583f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:53.713332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994132d7-5c95-427e-a440-3a99a24b583f service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:53.713616 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994132d7-5c95-427e-a440-3a99a24b583f service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:53.713890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994132d7-5c95-427e-a440-3a99a24b583f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:53.724585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994132d7-5c95-427e-a440-3a99a24b583f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:53.726115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994132d7-5c95-427e-a440-3a99a24b583f service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:53.739735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1077/2183] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:54.142660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af471f-a6d0-4452-a582-4555bc3e9cc7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:54.145393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d5af471f-a6d0-4452-a582-4555bc3e9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:54.163613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af471f-a6d0-4452-a582-4555bc3e9cc7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:54.169411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:54.170298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.170652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.171049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] PATH_INFO: `/v3/projects/8d309222a3104db18c849c00e23b7247` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.172207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d309222a3104db18c849c00e23b7247)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:54.174441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:54.222609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d309222a3104db18c849c00e23b7247', 'request_id': 'req-7ec856be-6353-4afd-abdb-964d4e4e152b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:54.227912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d309222a3104db18c849c00e23b7247', 'request_id': 'req-7ec856be-6353-4afd-abdb-964d4e4e152b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:54.236348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d309222a3104db18c849c00e23b7247', 'request_id': 'req-7ec856be-6353-4afd-abdb-964d4e4e152b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:54.247387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] The token cache is being invalidate because project 8d309222a3104db18c849c00e23b7247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:54.247658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:54.248468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7ec856be-6353-4afd-abdb-964d4e4e152b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:54.250208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1107/2184] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:54 2022] DELETE /identity/v3/projects/8d309222a3104db18c849c00e23b7247 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:54.255457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5a72-7b22-4b22-a0c3-1780434f7716 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.255749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5a72-7b22-4b22-a0c3-1780434f7716 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.256030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d5a72-7b22-4b22-a0c3-1780434f7716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.274148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-497d5a72-7b22-4b22-a0c3-1780434f7716 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:54.275407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-497d5a72-7b22-4b22-a0c3-1780434f7716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:54.340171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1078/2185] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:54.348833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2977-60ef-4faa-af19-5bc2e37665bb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.349174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2977-60ef-4faa-af19-5bc2e37665bb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.349479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2977-60ef-4faa-af19-5bc2e37665bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.357321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:54.371398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7f6d2977-60ef-4faa-af19-5bc2e37665bb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:54.373968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7f6d2977-60ef-4faa-af19-5bc2e37665bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:54.384902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1108/2186] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:54.388088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5a72-7b22-4b22-a0c3-1780434f7716 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:54.398610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d5a72-7b22-4b22-a0c3-1780434f7716 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:54.403376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04fb0-8eb3-44d7-bd27-640e57538614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:54.403962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04fb0-8eb3-44d7-bd27-640e57538614 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.404249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04fb0-8eb3-44d7-bd27-640e57538614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.404515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d04fb0-8eb3-44d7-bd27-640e57538614 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.405269 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d04fb0-8eb3-44d7-bd27-640e57538614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:54.405571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d04fb0-8eb3-44d7-bd27-640e57538614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:54.407175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d04fb0-8eb3-44d7-bd27-640e57538614 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:54.426804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1079/2187] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:54.431197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2977-60ef-4faa-af19-5bc2e37665bb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:54.440784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2977-60ef-4faa-af19-5bc2e37665bb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:54.446065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0c94e-457e-4645-8b11-74d111e6adac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:54.446747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0c94e-457e-4645-8b11-74d111e6adac admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.446994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0c94e-457e-4645-8b11-74d111e6adac admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.447394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0c94e-457e-4645-8b11-74d111e6adac admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.448105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0c94e-457e-4645-8b11-74d111e6adac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:54.450097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed0c94e-457e-4645-8b11-74d111e6adac admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:54.478221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1109/2188] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:54 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:54.482458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04fb0-8eb3-44d7-bd27-640e57538614 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:54.495179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d04fb0-8eb3-44d7-bd27-640e57538614 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:54.528403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:54.570547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a375631-193f-4e90-85bd-6c5c608237fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:54.571237 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a375631-193f-4e90-85bd-6c5c608237fe admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.571514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a375631-193f-4e90-85bd-6c5c608237fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.571813 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a375631-193f-4e90-85bd-6c5c608237fe admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.572480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a375631-193f-4e90-85bd-6c5c608237fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:54.574466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a375631-193f-4e90-85bd-6c5c608237fe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:54.602651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1080/2189] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:54 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:54.606812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0c94e-457e-4645-8b11-74d111e6adac admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:54.617740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed0c94e-457e-4645-8b11-74d111e6adac admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:54.622889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73d825-dd95-4c1a-a362-dd629be3b22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:54.623565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73d825-dd95-4c1a-a362-dd629be3b22e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.623944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73d825-dd95-4c1a-a362-dd629be3b22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.624139 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73d825-dd95-4c1a-a362-dd629be3b22e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.624892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73d825-dd95-4c1a-a362-dd629be3b22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:54.626572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73d825-dd95-4c1a-a362-dd629be3b22e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:54.637355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1110/2190] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:54.641422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a375631-193f-4e90-85bd-6c5c608237fe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:54.651531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a375631-193f-4e90-85bd-6c5c608237fe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:54.656046 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665a089-e0a7-4884-b7eb-596255368115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:54.656705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665a089-e0a7-4884-b7eb-596255368115 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.657018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665a089-e0a7-4884-b7eb-596255368115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.657411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665a089-e0a7-4884-b7eb-596255368115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.658236 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665a089-e0a7-4884-b7eb-596255368115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:54.659844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665a089-e0a7-4884-b7eb-596255368115 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:54.669601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1081/2191] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:54.675545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73d825-dd95-4c1a-a362-dd629be3b22e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:54.690460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73d825-dd95-4c1a-a362-dd629be3b22e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:54.696417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efacad-2149-434e-a5f2-66c8cb85bdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:54.697380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efacad-2149-434e-a5f2-66c8cb85bdc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.697659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efacad-2149-434e-a5f2-66c8cb85bdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.697999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efacad-2149-434e-a5f2-66c8cb85bdc9 admin admin] PATH_INFO: `/v3/projects/55d0b8971faf4bb6af6efd2256698500/users/c6ef05caf2a243349a33ddc3193f8874/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.713455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efacad-2149-434e-a5f2-66c8cb85bdc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d0b8971faf4bb6af6efd2256698500, user_id=c6ef05caf2a243349a33ddc3193f8874, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:54.716301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efacad-2149-434e-a5f2-66c8cb85bdc9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:54.732627 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1111/2192] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:54 2022] PUT /identity/v3/projects/55d0b8971faf4bb6af6efd2256698500/users/c6ef05caf2a243349a33ddc3193f8874/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:54.744339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b998e4-121e-4fcc-a0c4-c58897b43160 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.744624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b998e4-121e-4fcc-a0c4-c58897b43160 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.744929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b998e4-121e-4fcc-a0c4-c58897b43160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.771678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-64b998e4-121e-4fcc-a0c4-c58897b43160 None None] MFA Rules not processed for user `c6ef05caf2a243349a33ddc3193f8874`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:54.772949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-64b998e4-121e-4fcc-a0c4-c58897b43160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:54.843624 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1082/2193] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:54.848668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efacad-2149-434e-a5f2-66c8cb85bdc9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:54.916274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efacad-2149-434e-a5f2-66c8cb85bdc9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:54.921657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0b1cb-5227-4bc3-8b02-863c6365d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:54.922320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0b1cb-5227-4bc3-8b02-863c6365d68b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:54.922617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0b1cb-5227-4bc3-8b02-863c6365d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:54.922954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0b1cb-5227-4bc3-8b02-863c6365d68b admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:54.923645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0b1cb-5227-4bc3-8b02-863c6365d68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:54.925620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0b1cb-5227-4bc3-8b02-863c6365d68b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:54.952671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1112/2194] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:54 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:54.957090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b998e4-121e-4fcc-a0c4-c58897b43160 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:54.968130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b998e4-121e-4fcc-a0c4-c58897b43160 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.045600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa538-17c2-4b05-9b1b-ddb5908358f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.046801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa538-17c2-4b05-9b1b-ddb5908358f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.047267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa538-17c2-4b05-9b1b-ddb5908358f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.047807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa538-17c2-4b05-9b1b-ddb5908358f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.049310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa538-17c2-4b05-9b1b-ddb5908358f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.051515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa538-17c2-4b05-9b1b-ddb5908358f5 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.075765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1083/2195] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:54 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:55.081173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0b1cb-5227-4bc3-8b02-863c6365d68b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:55.091887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0b1cb-5227-4bc3-8b02-863c6365d68b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.097817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e352c8-a582-4fb2-90b5-6dec229cf3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.098478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e352c8-a582-4fb2-90b5-6dec229cf3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.098756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e352c8-a582-4fb2-90b5-6dec229cf3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.099051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e352c8-a582-4fb2-90b5-6dec229cf3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.099761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e352c8-a582-4fb2-90b5-6dec229cf3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.101383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e352c8-a582-4fb2-90b5-6dec229cf3d9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.113860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1113/2196] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:55.118022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa538-17c2-4b05-9b1b-ddb5908358f5 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:55.128458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa538-17c2-4b05-9b1b-ddb5908358f5 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.133412 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e394960-7ec6-4319-a86b-463d2f72b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.134107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e394960-7ec6-4319-a86b-463d2f72b897 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.134396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e394960-7ec6-4319-a86b-463d2f72b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.134675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e394960-7ec6-4319-a86b-463d2f72b897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.135419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e394960-7ec6-4319-a86b-463d2f72b897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.137072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e394960-7ec6-4319-a86b-463d2f72b897 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.151781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1084/2197] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:55.153949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e352c8-a582-4fb2-90b5-6dec229cf3d9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:55.165240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e352c8-a582-4fb2-90b5-6dec229cf3d9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.173524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299568f-d9c5-489d-b0d1-550326c2c183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.174847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299568f-d9c5-489d-b0d1-550326c2c183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.175272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299568f-d9c5-489d-b0d1-550326c2c183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.176046 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299568f-d9c5-489d-b0d1-550326c2c183 admin admin] PATH_INFO: `/v3/projects/dd5f28b5377f49af82c7cf48093efb36/users/df71dba4b5624b34a20f4bfef8cad83b/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.201256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299568f-d9c5-489d-b0d1-550326c2c183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5f28b5377f49af82c7cf48093efb36, user_id=df71dba4b5624b34a20f4bfef8cad83b, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.203958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299568f-d9c5-489d-b0d1-550326c2c183 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.223973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1114/2198] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:55 2022] PUT /identity/v3/projects/dd5f28b5377f49af82c7cf48093efb36/users/df71dba4b5624b34a20f4bfef8cad83b/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:55.234211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f39b-0496-40f9-8adf-e996e13e4b12 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.234496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f39b-0496-40f9-8adf-e996e13e4b12 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.234772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f39b-0496-40f9-8adf-e996e13e4b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.267135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8390f39b-0496-40f9-8adf-e996e13e4b12 None None] MFA Rules not processed for user `df71dba4b5624b34a20f4bfef8cad83b`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:55.268718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8390f39b-0496-40f9-8adf-e996e13e4b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:55.278720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:55.355137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1085/2199] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:55.360039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299568f-d9c5-489d-b0d1-550326c2c183 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:55.411892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:55.434186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299568f-d9c5-489d-b0d1-550326c2c183 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.439936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39f8da-fb4f-4921-8200-8fce38a8bb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.441174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39f8da-fb4f-4921-8200-8fce38a8bb0b admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.441629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39f8da-fb4f-4921-8200-8fce38a8bb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.442073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39f8da-fb4f-4921-8200-8fce38a8bb0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.443231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39f8da-fb4f-4921-8200-8fce38a8bb0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.445941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39f8da-fb4f-4921-8200-8fce38a8bb0b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.492694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1115/2200] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:55 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:55.497123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f39b-0496-40f9-8adf-e996e13e4b12 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:55.511294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f39b-0496-40f9-8adf-e996e13e4b12 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.590292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e3f67-40ea-4967-872a-dd4fbfa79320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.591049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3f67-40ea-4967-872a-dd4fbfa79320 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.591276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3f67-40ea-4967-872a-dd4fbfa79320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.591540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e3f67-40ea-4967-872a-dd4fbfa79320 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.592242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e3f67-40ea-4967-872a-dd4fbfa79320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.596454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e3f67-40ea-4967-872a-dd4fbfa79320 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.619277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1086/2201] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:55 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:55.622996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39f8da-fb4f-4921-8200-8fce38a8bb0b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:55.636436 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39f8da-fb4f-4921-8200-8fce38a8bb0b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.641339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4399d79-a4aa-4e10-adb8-0a2bd4045cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.642398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4399d79-a4aa-4e10-adb8-0a2bd4045cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.642684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4399d79-a4aa-4e10-adb8-0a2bd4045cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.642964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4399d79-a4aa-4e10-adb8-0a2bd4045cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.643706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4399d79-a4aa-4e10-adb8-0a2bd4045cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.645479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4399d79-a4aa-4e10-adb8-0a2bd4045cd2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.658680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1116/2202] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:55.663050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e3f67-40ea-4967-872a-dd4fbfa79320 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:55.674035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e3f67-40ea-4967-872a-dd4fbfa79320 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.679514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7bbde-ec35-4f69-aba2-773fa17bc7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.680232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7bbde-ec35-4f69-aba2-773fa17bc7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.680519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7bbde-ec35-4f69-aba2-773fa17bc7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.680795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7bbde-ec35-4f69-aba2-773fa17bc7e2 admin admin] PATH_INFO: `/v3/projects/338e88b1781a4bd5bdbab6e82885ea91/users/426eb73e0e9c448fbb1fa78ad2232364/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.697558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7bbde-ec35-4f69-aba2-773fa17bc7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=338e88b1781a4bd5bdbab6e82885ea91, user_id=426eb73e0e9c448fbb1fa78ad2232364, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.700590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7bbde-ec35-4f69-aba2-773fa17bc7e2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.716521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1087/2203] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:55 2022] PUT /identity/v3/projects/338e88b1781a4bd5bdbab6e82885ea91/users/426eb73e0e9c448fbb1fa78ad2232364/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:55.721335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4399d79-a4aa-4e10-adb8-0a2bd4045cd2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:55.736183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4399d79-a4aa-4e10-adb8-0a2bd4045cd2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.821872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460bc86-6c75-4af1-a864-c373cae79778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.822793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460bc86-6c75-4af1-a864-c373cae79778 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.823076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460bc86-6c75-4af1-a864-c373cae79778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.823415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460bc86-6c75-4af1-a864-c373cae79778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.824384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460bc86-6c75-4af1-a864-c373cae79778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.826314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460bc86-6c75-4af1-a864-c373cae79778 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.840747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1117/2204] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:55.845549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7bbde-ec35-4f69-aba2-773fa17bc7e2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:55.865141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7bbde-ec35-4f69-aba2-773fa17bc7e2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:55.870168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2747fee-0b7d-446d-b651-ab50990fb6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:55.871223 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2747fee-0b7d-446d-b651-ab50990fb6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.871458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2747fee-0b7d-446d-b651-ab50990fb6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.871745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2747fee-0b7d-446d-b651-ab50990fb6e6 admin admin] PATH_INFO: `/v3/projects/338e88b1781a4bd5bdbab6e82885ea91/users/426eb73e0e9c448fbb1fa78ad2232364/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.873895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2747fee-0b7d-446d-b651-ab50990fb6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=338e88b1781a4bd5bdbab6e82885ea91, user_id=426eb73e0e9c448fbb1fa78ad2232364, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:55.876722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2747fee-0b7d-446d-b651-ab50990fb6e6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:55.887198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1088/2205] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:55 2022] PUT /identity/v3/projects/338e88b1781a4bd5bdbab6e82885ea91/users/426eb73e0e9c448fbb1fa78ad2232364/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:55.897901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf8a1d-894a-4eee-98c2-94945f86991d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:55.898196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf8a1d-894a-4eee-98c2-94945f86991d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:55.898476 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf8a1d-894a-4eee-98c2-94945f86991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:55.924499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1faf8a1d-894a-4eee-98c2-94945f86991d None None] MFA Rules not processed for user `426eb73e0e9c448fbb1fa78ad2232364`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:55.925772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1faf8a1d-894a-4eee-98c2-94945f86991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:56.000410 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1118/2206] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:56.012316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2747fee-0b7d-446d-b651-ab50990fb6e6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:56.014256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a2747fee-0b7d-446d-b651-ab50990fb6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:56.083313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2747fee-0b7d-446d-b651-ab50990fb6e6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:56.087167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f20865-b979-43ba-b750-1d6d0fd00a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:56.087815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f20865-b979-43ba-b750-1d6d0fd00a1b service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:56.088104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f20865-b979-43ba-b750-1d6d0fd00a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:56.088382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f20865-b979-43ba-b750-1d6d0fd00a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:56.103314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:56.152220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f20865-b979-43ba-b750-1d6d0fd00a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:56.153673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f20865-b979-43ba-b750-1d6d0fd00a1b service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:56.162892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1089/2207] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:56.633102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf8a1d-894a-4eee-98c2-94945f86991d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:56.643426 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf8a1d-894a-4eee-98c2-94945f86991d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:56.647779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9801e82-648e-4ba9-a01b-4a25f538db45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:56.648418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801e82-648e-4ba9-a01b-4a25f538db45 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:56.648698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801e82-648e-4ba9-a01b-4a25f538db45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:56.649003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9801e82-648e-4ba9-a01b-4a25f538db45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:56.650966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a9801e82-648e-4ba9-a01b-4a25f538db45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:56.698638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:56.718043 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9801e82-648e-4ba9-a01b-4a25f538db45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:56.719867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9801e82-648e-4ba9-a01b-4a25f538db45 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:56.730971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1119/2208] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:31:56.889417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f20865-b979-43ba-b750-1d6d0fd00a1b service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:56.890951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f3f20865-b979-43ba-b750-1d6d0fd00a1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:56.965194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f20865-b979-43ba-b750-1d6d0fd00a1b service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:56.970420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:56.971370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:56.971658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:56.971932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] PATH_INFO: `/v3/users/d91816dbea524da9a8d17d07a50cd3de` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:56.973204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d91816dbea524da9a8d17d07a50cd3de)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:56.975211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:57.041494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd91816dbea524da9a8d17d07a50cd3de'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.042547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd91816dbea524da9a8d17d07a50cd3de'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.043970 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd91816dbea524da9a8d17d07a50cd3de'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.058951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd91816dbea524da9a8d17d07a50cd3de'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.074927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd91816dbea524da9a8d17d07a50cd3de'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.098857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1090/2209] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:31:56 2022] DELETE /identity/v3/users/d91816dbea524da9a8d17d07a50cd3de => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:57.103454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e526d-408e-419f-b31c-45308181ef67 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:57.103813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e526d-408e-419f-b31c-45308181ef67 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:57.104162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e526d-408e-419f-b31c-45308181ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:57.125174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c87e526d-408e-419f-b31c-45308181ef67 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:57.126511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c87e526d-408e-419f-b31c-45308181ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:57.196631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1120/2210] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:57.206475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:57.207897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:57.261086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:57.289673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d32e1f-899a-44b8-9eaf-d5006e394a8e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:57.293457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cf4ed-12fb-4f24-bce2-a6fc97a2c989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:57.294115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf4ed-12fb-4f24-bce2-a6fc97a2c989 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:57.294398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf4ed-12fb-4f24-bce2-a6fc97a2c989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:57.294725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf4ed-12fb-4f24-bce2-a6fc97a2c989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:57.304681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cf4ed-12fb-4f24-bce2-a6fc97a2c989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:57.306449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cf4ed-12fb-4f24-bce2-a6fc97a2c989 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:57.318482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1091/2211] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:31:57.618470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e526d-408e-419f-b31c-45308181ef67 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:57.620185 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c87e526d-408e-419f-b31c-45308181ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:57.637967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e526d-408e-419f-b31c-45308181ef67 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:57.644089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:57.645079 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:57.645430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:57.645779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] PATH_INFO: `/v3/projects/0fd2400f2cfb45e18c2b00ec9e4cf94c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:57.647077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd2400f2cfb45e18c2b00ec9e4cf94c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:57.649650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:57.704238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd2400f2cfb45e18c2b00ec9e4cf94c', 'request_id': 'req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.711096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd2400f2cfb45e18c2b00ec9e4cf94c', 'request_id': 'req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.712361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cf4ed-12fb-4f24-bce2-a6fc97a2c989 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:57.713843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-247cf4ed-12fb-4f24-bce2-a6fc97a2c989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:57.727475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd2400f2cfb45e18c2b00ec9e4cf94c', 'request_id': 'req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.741814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] The token cache is being invalidate because project 0fd2400f2cfb45e18c2b00ec9e4cf94c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:31:57.742534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.743357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-e453f23f-1b8a-43a3-9fa5-b7d25d3b9002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:31:57.745144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1121/2212] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:31:57 2022] DELETE /identity/v3/projects/0fd2400f2cfb45e18c2b00ec9e4cf94c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:57.750176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f680c0-57e6-4c52-b4ba-78c98eb04b7e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:57.750467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f680c0-57e6-4c52-b4ba-78c98eb04b7e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:57.750873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f680c0-57e6-4c52-b4ba-78c98eb04b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:57.770515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-b5f680c0-57e6-4c52-b4ba-78c98eb04b7e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:57.772370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b5f680c0-57e6-4c52-b4ba-78c98eb04b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:57.777898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cf4ed-12fb-4f24-bce2-a6fc97a2c989 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:57.828586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24988759-8edb-4c49-afe5-0d90a0f21e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:57.829276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24988759-8edb-4c49-afe5-0d90a0f21e35 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:57.829554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24988759-8edb-4c49-afe5-0d90a0f21e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:57.829824 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24988759-8edb-4c49-afe5-0d90a0f21e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:57.831699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-24988759-8edb-4c49-afe5-0d90a0f21e35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:57.832925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1122/2213] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:57.840590 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e61f8-a177-44d3-9081-e40cbe17253f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:57.840916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e61f8-a177-44d3-9081-e40cbe17253f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:57.841201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e61f8-a177-44d3-9081-e40cbe17253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:57.848535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:57.859866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e98e61f8-a177-44d3-9081-e40cbe17253f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:57.861464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e98e61f8-a177-44d3-9081-e40cbe17253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:57.869936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1123/2214] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:31:57.873925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e61f8-a177-44d3-9081-e40cbe17253f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:57.882949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e61f8-a177-44d3-9081-e40cbe17253f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:57.887834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacb65e-9f9d-4414-bf04-d9b201d37e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:57.888493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacb65e-9f9d-4414-bf04-d9b201d37e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:57.888775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacb65e-9f9d-4414-bf04-d9b201d37e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:57.889168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacb65e-9f9d-4414-bf04-d9b201d37e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:57.889995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacb65e-9f9d-4414-bf04-d9b201d37e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:31:57.890320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacb65e-9f9d-4414-bf04-d9b201d37e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:57.891969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacb65e-9f9d-4414-bf04-d9b201d37e2d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:57.894674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24988759-8edb-4c49-afe5-0d90a0f21e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:57.896249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24988759-8edb-4c49-afe5-0d90a0f21e35 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:57.904879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1124/2215] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:31:57.906212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1092/2216] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:31:57.909105 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacb65e-9f9d-4414-bf04-d9b201d37e2d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:57.920365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacb65e-9f9d-4414-bf04-d9b201d37e2d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:57.926051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184982f-0bdb-4035-a527-077c08711f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:57.926736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184982f-0bdb-4035-a527-077c08711f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:57.927036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184982f-0bdb-4035-a527-077c08711f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:57.927315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184982f-0bdb-4035-a527-077c08711f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:57.928029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184982f-0bdb-4035-a527-077c08711f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:57.931257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184982f-0bdb-4035-a527-077c08711f4c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:57.963430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1125/2217] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:57 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:57.964812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24988759-8edb-4c49-afe5-0d90a0f21e35 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:57.977361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24988759-8edb-4c49-afe5-0d90a0f21e35 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.024721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:58.038397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da7364-b796-4358-af47-0d94fdbeaea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.039082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da7364-b796-4358-af47-0d94fdbeaea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.039365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da7364-b796-4358-af47-0d94fdbeaea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.039630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da7364-b796-4358-af47-0d94fdbeaea6 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.040322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da7364-b796-4358-af47-0d94fdbeaea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.042316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da7364-b796-4358-af47-0d94fdbeaea6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.074964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1093/2218] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:57 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:58.078967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184982f-0bdb-4035-a527-077c08711f4c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:58.099353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184982f-0bdb-4035-a527-077c08711f4c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.099353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f513149-2bf2-4764-8832-ca557b445d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.099353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f513149-2bf2-4764-8832-ca557b445d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.099353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f513149-2bf2-4764-8832-ca557b445d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.099651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f513149-2bf2-4764-8832-ca557b445d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.099651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f513149-2bf2-4764-8832-ca557b445d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.099651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f513149-2bf2-4764-8832-ca557b445d84 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.112170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1126/2219] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:58.116333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da7364-b796-4358-af47-0d94fdbeaea6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:58.127553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da7364-b796-4358-af47-0d94fdbeaea6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.132682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507665-1d15-4e0d-be57-c26dccf7046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.137371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507665-1d15-4e0d-be57-c26dccf7046e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.137939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507665-1d15-4e0d-be57-c26dccf7046e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.138489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507665-1d15-4e0d-be57-c26dccf7046e admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.143381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507665-1d15-4e0d-be57-c26dccf7046e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.146712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507665-1d15-4e0d-be57-c26dccf7046e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.163129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1094/2220] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:58.164340 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f513149-2bf2-4764-8832-ca557b445d84 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:58.176680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f513149-2bf2-4764-8832-ca557b445d84 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.182736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3584ca5-bc70-471b-a6d0-fa7be51944f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.183791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584ca5-bc70-471b-a6d0-fa7be51944f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.184055 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584ca5-bc70-471b-a6d0-fa7be51944f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.184331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3584ca5-bc70-471b-a6d0-fa7be51944f2 admin admin] PATH_INFO: `/v3/projects/d5df616c441146b399caf67d835ad738/users/aca6d03ec369454caeb9926c3f9bfcb8/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.212475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3584ca5-bc70-471b-a6d0-fa7be51944f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5df616c441146b399caf67d835ad738, user_id=aca6d03ec369454caeb9926c3f9bfcb8, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.215450 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3584ca5-bc70-471b-a6d0-fa7be51944f2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.236924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1127/2221] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:58 2022] PUT /identity/v3/projects/d5df616c441146b399caf67d835ad738/users/aca6d03ec369454caeb9926c3f9bfcb8/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:58.247201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d032-9448-44dd-bdd4-6e9ef068ffc4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.247494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d032-9448-44dd-bdd4-6e9ef068ffc4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.247760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375d032-9448-44dd-bdd4-6e9ef068ffc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.289488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f375d032-9448-44dd-bdd4-6e9ef068ffc4 None None] MFA Rules not processed for user `aca6d03ec369454caeb9926c3f9bfcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:58.291893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f375d032-9448-44dd-bdd4-6e9ef068ffc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:58.399586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1095/2222] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:58.404154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3584ca5-bc70-471b-a6d0-fa7be51944f2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:58.485404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3584ca5-bc70-471b-a6d0-fa7be51944f2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.502523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92185ee-d6f5-4c40-b89c-14d5c4c865dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.503283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92185ee-d6f5-4c40-b89c-14d5c4c865dc admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.503607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92185ee-d6f5-4c40-b89c-14d5c4c865dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.503931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92185ee-d6f5-4c40-b89c-14d5c4c865dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.504649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92185ee-d6f5-4c40-b89c-14d5c4c865dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.507270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92185ee-d6f5-4c40-b89c-14d5c4c865dc admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.543841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1128/2223] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:58 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:58.544726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375d032-9448-44dd-bdd4-6e9ef068ffc4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:58.556937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375d032-9448-44dd-bdd4-6e9ef068ffc4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.626410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed983c8-b27a-4c5c-bf97-e3ff612544de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.627146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed983c8-b27a-4c5c-bf97-e3ff612544de admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.627466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed983c8-b27a-4c5c-bf97-e3ff612544de admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.627768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed983c8-b27a-4c5c-bf97-e3ff612544de admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.628585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed983c8-b27a-4c5c-bf97-e3ff612544de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.631676 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed983c8-b27a-4c5c-bf97-e3ff612544de admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.632007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92185ee-d6f5-4c40-b89c-14d5c4c865dc admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:58.637394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e92185ee-d6f5-4c40-b89c-14d5c4c865dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:58.656136 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1096/2224] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:58 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:31:58.660181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed983c8-b27a-4c5c-bf97-e3ff612544de admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:58.672275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed983c8-b27a-4c5c-bf97-e3ff612544de admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.677096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf040e1-4efb-4474-b5e1-37e0defc6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.677794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf040e1-4efb-4474-b5e1-37e0defc6de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.678077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf040e1-4efb-4474-b5e1-37e0defc6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.678342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf040e1-4efb-4474-b5e1-37e0defc6de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.679215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf040e1-4efb-4474-b5e1-37e0defc6de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.681022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf040e1-4efb-4474-b5e1-37e0defc6de1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.693397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1097/2225] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:58.697145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf040e1-4efb-4474-b5e1-37e0defc6de1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:58.707911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf040e1-4efb-4474-b5e1-37e0defc6de1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.711282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92185ee-d6f5-4c40-b89c-14d5c4c865dc admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.713475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d019ef-95ed-415d-bd06-1dc511ed7e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.714146 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d019ef-95ed-415d-bd06-1dc511ed7e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.714423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d019ef-95ed-415d-bd06-1dc511ed7e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.714695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d019ef-95ed-415d-bd06-1dc511ed7e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.715795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d019ef-95ed-415d-bd06-1dc511ed7e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.715914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4b840-755e-4307-97f4-2c2de5892dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.716561 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4b840-755e-4307-97f4-2c2de5892dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.716860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4b840-755e-4307-97f4-2c2de5892dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.717153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4b840-755e-4307-97f4-2c2de5892dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.717301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d019ef-95ed-415d-bd06-1dc511ed7e27 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.719584 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c8a4b840-755e-4307-97f4-2c2de5892dc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:58.730868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1098/2226] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:31:58.738173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d019ef-95ed-415d-bd06-1dc511ed7e27 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:58.751630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d019ef-95ed-415d-bd06-1dc511ed7e27 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:58.758908 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297907a-365c-42f8-b51d-3b038dd70236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:58.760226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:58.761432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297907a-365c-42f8-b51d-3b038dd70236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.762086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297907a-365c-42f8-b51d-3b038dd70236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.762384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297907a-365c-42f8-b51d-3b038dd70236 admin admin] PATH_INFO: `/v3/projects/59890db274b74c3293ed94f3b95ae3ab/users/1687ce17cdab4875a05a2c1291f08374/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.791186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297907a-365c-42f8-b51d-3b038dd70236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59890db274b74c3293ed94f3b95ae3ab, user_id=1687ce17cdab4875a05a2c1291f08374, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.793880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297907a-365c-42f8-b51d-3b038dd70236 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.802284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4b840-755e-4307-97f4-2c2de5892dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:58.804486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4b840-755e-4307-97f4-2c2de5892dc5 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:58.810559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:58.817380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1129/2228] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:31:58.817703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1099/2228] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:58 2022] PUT /identity/v3/projects/59890db274b74c3293ed94f3b95ae3ab/users/1687ce17cdab4875a05a2c1291f08374/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:58.828669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be89a0-8308-4e54-95e6-41e952a5ec13 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:58.829020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be89a0-8308-4e54-95e6-41e952a5ec13 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:58.829293 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be89a0-8308-4e54-95e6-41e952a5ec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:58.864594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a3be89a0-8308-4e54-95e6-41e952a5ec13 None None] MFA Rules not processed for user `1687ce17cdab4875a05a2c1291f08374`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:58.865874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a3be89a0-8308-4e54-95e6-41e952a5ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:58.941298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1130/2229] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:58.945828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297907a-365c-42f8-b51d-3b038dd70236 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:59.010358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297907a-365c-42f8-b51d-3b038dd70236 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:59.015210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47bc6-dd19-4ad3-b818-e8edd16efe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:59.015878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47bc6-dd19-4ad3-b818-e8edd16efe80 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:59.016153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47bc6-dd19-4ad3-b818-e8edd16efe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:59.016424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47bc6-dd19-4ad3-b818-e8edd16efe80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:59.017272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47bc6-dd19-4ad3-b818-e8edd16efe80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:59.019461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47bc6-dd19-4ad3-b818-e8edd16efe80 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:59.047877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1100/2230] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:31:58 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:59.053212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be89a0-8308-4e54-95e6-41e952a5ec13 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:59.065938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be89a0-8308-4e54-95e6-41e952a5ec13 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:59.128895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc68780-88cb-40fe-8cc2-ce8a824e5217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:59.129580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc68780-88cb-40fe-8cc2-ce8a824e5217 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:59.129866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc68780-88cb-40fe-8cc2-ce8a824e5217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:59.130142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc68780-88cb-40fe-8cc2-ce8a824e5217 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:59.130864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc68780-88cb-40fe-8cc2-ce8a824e5217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:59.132808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc68780-88cb-40fe-8cc2-ce8a824e5217 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:59.154499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1131/2231] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:31:59 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:31:59.158826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47bc6-dd19-4ad3-b818-e8edd16efe80 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:59.169816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47bc6-dd19-4ad3-b818-e8edd16efe80 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:59.175401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32112e94-01af-4466-8244-946c8608b6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:59.176065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32112e94-01af-4466-8244-946c8608b6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:59.176348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32112e94-01af-4466-8244-946c8608b6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:59.176623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32112e94-01af-4466-8244-946c8608b6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:59.177403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32112e94-01af-4466-8244-946c8608b6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:59.179038 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32112e94-01af-4466-8244-946c8608b6fe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:59.190743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1101/2232] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:59.197097 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc68780-88cb-40fe-8cc2-ce8a824e5217 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:59.212883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc68780-88cb-40fe-8cc2-ce8a824e5217 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:59.221819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96bd16-6064-4ff7-824e-1b32c375cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:59.222705 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96bd16-6064-4ff7-824e-1b32c375cba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:59.222981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96bd16-6064-4ff7-824e-1b32c375cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:59.223249 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96bd16-6064-4ff7-824e-1b32c375cba3 admin admin] PATH_INFO: `/v3/projects/7b9d0aac3e184586bbe27fa4c95040fe/users/31e36a080c1448f092f58c9b21c685db/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:59.239290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96bd16-6064-4ff7-824e-1b32c375cba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9d0aac3e184586bbe27fa4c95040fe, user_id=31e36a080c1448f092f58c9b21c685db, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:59.242041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96bd16-6064-4ff7-824e-1b32c375cba3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:59.257301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1132/2233] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:59 2022] PUT /identity/v3/projects/7b9d0aac3e184586bbe27fa4c95040fe/users/31e36a080c1448f092f58c9b21c685db/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:59.261529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32112e94-01af-4466-8244-946c8608b6fe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:59.272425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32112e94-01af-4466-8244-946c8608b6fe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:59.334519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1cf00d-09e2-4391-8337-d18996c0f776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:59.335199 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cf00d-09e2-4391-8337-d18996c0f776 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:59.335486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cf00d-09e2-4391-8337-d18996c0f776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:59.335757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1cf00d-09e2-4391-8337-d18996c0f776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:59.336493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cf00d-09e2-4391-8337-d18996c0f776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:59.338204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1cf00d-09e2-4391-8337-d18996c0f776 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:59.349311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1102/2234] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:31:59.353680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96bd16-6064-4ff7-824e-1b32c375cba3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:59.364344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96bd16-6064-4ff7-824e-1b32c375cba3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:59.369207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aa423-05d2-4d89-9d52-14a677c07a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:59.370144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aa423-05d2-4d89-9d52-14a677c07a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:59.370423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aa423-05d2-4d89-9d52-14a677c07a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:59.370691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aa423-05d2-4d89-9d52-14a677c07a36 admin admin] PATH_INFO: `/v3/projects/7b9d0aac3e184586bbe27fa4c95040fe/users/31e36a080c1448f092f58c9b21c685db/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:59.373247 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8aa423-05d2-4d89-9d52-14a677c07a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9d0aac3e184586bbe27fa4c95040fe, user_id=31e36a080c1448f092f58c9b21c685db, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:59.376283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8aa423-05d2-4d89-9d52-14a677c07a36 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:59.388936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1133/2235] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:31:59 2022] PUT /identity/v3/projects/7b9d0aac3e184586bbe27fa4c95040fe/users/31e36a080c1448f092f58c9b21c685db/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:31:59.399849 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb80fd-cd66-413e-b420-a20260fcb12b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:59.400170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb80fd-cd66-413e-b420-a20260fcb12b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:59.400547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb80fd-cd66-413e-b420-a20260fcb12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:59.428519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a0cb80fd-cd66-413e-b420-a20260fcb12b None None] MFA Rules not processed for user `31e36a080c1448f092f58c9b21c685db`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:31:59.429837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0cb80fd-cd66-413e-b420-a20260fcb12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:31:59.499710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:59.510990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1103/2236] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:31:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:31:59.523167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aa423-05d2-4d89-9d52-14a677c07a36 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:31:59.530428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:31:59.591910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aa423-05d2-4d89-9d52-14a677c07a36 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:31:59.596487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fff6a-62d1-4bce-a5ff-e750c3696924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:31:59.597342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fff6a-62d1-4bce-a5ff-e750c3696924 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:31:59.597657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fff6a-62d1-4bce-a5ff-e750c3696924 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:31:59.597936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fff6a-62d1-4bce-a5ff-e750c3696924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:31:59.667394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fff6a-62d1-4bce-a5ff-e750c3696924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:31:59.668916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fff6a-62d1-4bce-a5ff-e750c3696924 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:31:59.678431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1134/2237] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:31:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:02.288356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb80fd-cd66-413e-b420-a20260fcb12b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:02.289924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0cb80fd-cd66-413e-b420-a20260fcb12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:02.303197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb80fd-cd66-413e-b420-a20260fcb12b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:02.307375 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057ef13-3ebd-440b-b019-5555ae213721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:02.308073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057ef13-3ebd-440b-b019-5555ae213721 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:02.308349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057ef13-3ebd-440b-b019-5555ae213721 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:02.308621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057ef13-3ebd-440b-b019-5555ae213721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:02.369962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057ef13-3ebd-440b-b019-5555ae213721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:02.371605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057ef13-3ebd-440b-b019-5555ae213721 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:02.382733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1104/2238] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:03.270008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fff6a-62d1-4bce-a5ff-e750c3696924 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:03.278810 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fff6a-62d1-4bce-a5ff-e750c3696924 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:03.282616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9048d6-2a23-4057-a9dc-e5ed0d0662dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:03.283272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9048d6-2a23-4057-a9dc-e5ed0d0662dd service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:03.283594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9048d6-2a23-4057-a9dc-e5ed0d0662dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:03.283875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9048d6-2a23-4057-a9dc-e5ed0d0662dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:03.293248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9048d6-2a23-4057-a9dc-e5ed0d0662dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:03.294698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9048d6-2a23-4057-a9dc-e5ed0d0662dd service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:03.305067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1135/2239] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:03.995272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057ef13-3ebd-440b-b019-5555ae213721 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:03.997961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2057ef13-3ebd-440b-b019-5555ae213721 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:04.067713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057ef13-3ebd-440b-b019-5555ae213721 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:04.072706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:04.073612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:04.073902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:04.074196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] PATH_INFO: `/v3/users/8d693f5b55bb4066b3a0d14a3aef2092` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:04.075421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d693f5b55bb4066b3a0d14a3aef2092)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:04.077367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:04.132082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d693f5b55bb4066b3a0d14a3aef2092'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.133170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d693f5b55bb4066b3a0d14a3aef2092'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.134010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d693f5b55bb4066b3a0d14a3aef2092'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.147638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d693f5b55bb4066b3a0d14a3aef2092'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.155353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d693f5b55bb4066b3a0d14a3aef2092'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.172522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1105/2240] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:03 2022] DELETE /identity/v3/users/8d693f5b55bb4066b3a0d14a3aef2092 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:04.177766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d3241-2cca-4f69-af05-d3dae646fd8e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:04.178388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d3241-2cca-4f69-af05-d3dae646fd8e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:04.179155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d3241-2cca-4f69-af05-d3dae646fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:04.203194 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c80d3241-2cca-4f69-af05-d3dae646fd8e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:04.204418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c80d3241-2cca-4f69-af05-d3dae646fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:04.238091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:04.239699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:04.258583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:04.271353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1136/2241] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:04.282266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d3241-2cca-4f69-af05-d3dae646fd8e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:04.284017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c80d3241-2cca-4f69-af05-d3dae646fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:04.330100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307653fd-43da-40d1-8350-e97de3d37d2a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:04.335301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:04.336178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:04.336465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:04.336766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] PATH_INFO: `/v3/users/c6ef05caf2a243349a33ddc3193f8874` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:04.338041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ef05caf2a243349a33ddc3193f8874)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:04.340176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:04.343074 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:04.348763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d3241-2cca-4f69-af05-d3dae646fd8e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:04.352986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ad578-8625-427a-9627-dd9d21451ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:04.353573 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad578-8625-427a-9627-dd9d21451ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:04.354169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad578-8625-427a-9627-dd9d21451ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:04.354460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ad578-8625-427a-9627-dd9d21451ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:04.367404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ad578-8625-427a-9627-dd9d21451ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:04.369273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ad578-8625-427a-9627-dd9d21451ca2 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:04.380939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1137/2242] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:32:04.395282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ef05caf2a243349a33ddc3193f8874'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.395992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ef05caf2a243349a33ddc3193f8874'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.396656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ef05caf2a243349a33ddc3193f8874'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.410713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ef05caf2a243349a33ddc3193f8874'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.417741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ef05caf2a243349a33ddc3193f8874'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.436770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1106/2243] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:04 2022] DELETE /identity/v3/users/c6ef05caf2a243349a33ddc3193f8874 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:04.438783 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcce3d-a05a-4d00-8c97-79b1c6793a9d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:04.439069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcce3d-a05a-4d00-8c97-79b1c6793a9d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:04.439341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcce3d-a05a-4d00-8c97-79b1c6793a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:04.463719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cedcce3d-a05a-4d00-8c97-79b1c6793a9d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:04.465500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cedcce3d-a05a-4d00-8c97-79b1c6793a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:04.535821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1138/2244] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:04.556080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:04.557721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:04.625264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bbec0-144f-4dbe-964e-dc14e7007731 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:04.629696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c3e86-7851-4f60-83f7-ac24cc9d7caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:04.630687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c3e86-7851-4f60-83f7-ac24cc9d7caa service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:04.630982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c3e86-7851-4f60-83f7-ac24cc9d7caa service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:04.631261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c3e86-7851-4f60-83f7-ac24cc9d7caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:04.643042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c3e86-7851-4f60-83f7-ac24cc9d7caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:04.644524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c3e86-7851-4f60-83f7-ac24cc9d7caa service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:04.655384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1107/2245] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:04.725135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcce3d-a05a-4d00-8c97-79b1c6793a9d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:04.726836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cedcce3d-a05a-4d00-8c97-79b1c6793a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:04.744600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcce3d-a05a-4d00-8c97-79b1c6793a9d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:04.760725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:04.762268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:04.762698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:04.762977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] PATH_INFO: `/v3/projects/3a719c1a28a64ad79ae87d1b23a2364c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:04.766005 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a719c1a28a64ad79ae87d1b23a2364c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:04.769527 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:04.834056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a719c1a28a64ad79ae87d1b23a2364c', 'request_id': 'req-98674d2c-5bc4-42ed-888b-413ae368ecbd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.840937 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a719c1a28a64ad79ae87d1b23a2364c', 'request_id': 'req-98674d2c-5bc4-42ed-888b-413ae368ecbd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.852107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a719c1a28a64ad79ae87d1b23a2364c', 'request_id': 'req-98674d2c-5bc4-42ed-888b-413ae368ecbd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.867654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] The token cache is being invalidate because project 3a719c1a28a64ad79ae87d1b23a2364c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:04.868108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.868614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:04.871254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1139/2246] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:04 2022] DELETE /identity/v3/projects/3a719c1a28a64ad79ae87d1b23a2364c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:04.875413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c3e86-7851-4f60-83f7-ac24cc9d7caa service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:04.885424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c3e86-7851-4f60-83f7-ac24cc9d7caa service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:04.919804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:04.952572 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:04.953579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:04.953930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:04.954300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] PATH_INFO: `/v3/users/54592c76aadf47e5a1bf73dd9f867156` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:04.955629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=54592c76aadf47e5a1bf73dd9f867156)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:04.957879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:04.991569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:04.993038 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:05.011548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674d2c-5bc4-42ed-888b-413ae368ecbd admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:05.011704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54592c76aadf47e5a1bf73dd9f867156'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.012370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54592c76aadf47e5a1bf73dd9f867156'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.013125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54592c76aadf47e5a1bf73dd9f867156'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.016637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:05.017647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.018030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.018539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] PATH_INFO: `/v3/projects/55d0b8971faf4bb6af6efd2256698500` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.020001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d0b8971faf4bb6af6efd2256698500)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:05.022375 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:05.027423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54592c76aadf47e5a1bf73dd9f867156'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.035554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54592c76aadf47e5a1bf73dd9f867156'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.051524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1108/2247] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:04 2022] DELETE /identity/v3/users/54592c76aadf47e5a1bf73dd9f867156 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:05.078349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d0b8971faf4bb6af6efd2256698500', 'request_id': 'req-69b338d9-fc39-4c98-b636-a6136ab6ede1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.085944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d0b8971faf4bb6af6efd2256698500', 'request_id': 'req-69b338d9-fc39-4c98-b636-a6136ab6ede1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.096832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d0b8971faf4bb6af6efd2256698500', 'request_id': 'req-69b338d9-fc39-4c98-b636-a6136ab6ede1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.098841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:05.111153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] The token cache is being invalidate because project 55d0b8971faf4bb6af6efd2256698500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:05.111669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.112540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.114546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1140/2248] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:04 2022] DELETE /identity/v3/projects/55d0b8971faf4bb6af6efd2256698500 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:05.118428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:05.119867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:05.194118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ff215-4f3d-4494-a37d-7c33ba62b2fe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:05.261964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:05.263284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.263677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.264082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] PATH_INFO: `/v3/users/df71dba4b5624b34a20f4bfef8cad83b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.266153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df71dba4b5624b34a20f4bfef8cad83b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:05.268884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:05.273749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:05.332053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df71dba4b5624b34a20f4bfef8cad83b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.334574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df71dba4b5624b34a20f4bfef8cad83b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.335165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df71dba4b5624b34a20f4bfef8cad83b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.351447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:05.352964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:05.353931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df71dba4b5624b34a20f4bfef8cad83b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.362710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-cc01f53d-8040-4f46-8cc0-298e8bb7f03f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df71dba4b5624b34a20f4bfef8cad83b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.370940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b338d9-fc39-4c98-b636-a6136ab6ede1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:05.377570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:05.378636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.379847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.379847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] PATH_INFO: `/v3/projects/9a7ba29f2aa748c5939d970822491b81` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.381099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a7ba29f2aa748c5939d970822491b81)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:05.383451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:05.391292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1109/2249] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:05 2022] DELETE /identity/v3/users/df71dba4b5624b34a20f4bfef8cad83b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:05.449581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a7ba29f2aa748c5939d970822491b81', 'request_id': 'req-4978ca33-bf1a-4822-a41a-53f081dc75f2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.456276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a7ba29f2aa748c5939d970822491b81', 'request_id': 'req-4978ca33-bf1a-4822-a41a-53f081dc75f2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.466000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a7ba29f2aa748c5939d970822491b81', 'request_id': 'req-4978ca33-bf1a-4822-a41a-53f081dc75f2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.492034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] The token cache is being invalidate because project 9a7ba29f2aa748c5939d970822491b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:05.493117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.494004 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4978ca33-bf1a-4822-a41a-53f081dc75f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.496552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1141/2250] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:05 2022] DELETE /identity/v3/projects/9a7ba29f2aa748c5939d970822491b81 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:05.502348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb68a6-ec49-4688-aa6b-d746330cc8d4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.502669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb68a6-ec49-4688-aa6b-d746330cc8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.502962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb68a6-ec49-4688-aa6b-d746330cc8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.530250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cbbb68a6-ec49-4688-aa6b-d746330cc8d4 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:05.531657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cbbb68a6-ec49-4688-aa6b-d746330cc8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:05.608753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1110/2251] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:05.617463 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c91b8-0b76-4028-a35b-eb9710a35220 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.617755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c91b8-0b76-4028-a35b-eb9710a35220 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.618033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c91b8-0b76-4028-a35b-eb9710a35220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.639056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a01c91b8-0b76-4028-a35b-eb9710a35220 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:05.640362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a01c91b8-0b76-4028-a35b-eb9710a35220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:05.648748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1142/2252] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:05.653037 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb68a6-ec49-4688-aa6b-d746330cc8d4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:05.663789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb68a6-ec49-4688-aa6b-d746330cc8d4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:05.669078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bf401-41f4-4e61-a682-ac55dc2761d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:05.669731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bf401-41f4-4e61-a682-ac55dc2761d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.669995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bf401-41f4-4e61-a682-ac55dc2761d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.670275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bf401-41f4-4e61-a682-ac55dc2761d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.671077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bf401-41f4-4e61-a682-ac55dc2761d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:32:05.671387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bf401-41f4-4e61-a682-ac55dc2761d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:05.673248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bf401-41f4-4e61-a682-ac55dc2761d3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:05.686829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1111/2253] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:32:05.691460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c91b8-0b76-4028-a35b-eb9710a35220 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:05.700883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c91b8-0b76-4028-a35b-eb9710a35220 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:05.705720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4df73e-778a-4eb2-bfc3-038cc695f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:05.706392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4df73e-778a-4eb2-bfc3-038cc695f90f admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.706666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4df73e-778a-4eb2-bfc3-038cc695f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.707179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4df73e-778a-4eb2-bfc3-038cc695f90f admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.707892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4df73e-778a-4eb2-bfc3-038cc695f90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:05.709864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4df73e-778a-4eb2-bfc3-038cc695f90f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:05.743809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1143/2254] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:32:05 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:05.750011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bf401-41f4-4e61-a682-ac55dc2761d3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:05.762395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bf401-41f4-4e61-a682-ac55dc2761d3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:05.774298 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4df73e-778a-4eb2-bfc3-038cc695f90f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:05.777619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-af4df73e-778a-4eb2-bfc3-038cc695f90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:05.835654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71748ac-01f1-4897-8a9d-41ed29c9359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:05.836565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71748ac-01f1-4897-8a9d-41ed29c9359d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.836874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71748ac-01f1-4897-8a9d-41ed29c9359d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.837177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71748ac-01f1-4897-8a9d-41ed29c9359d admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.838297 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71748ac-01f1-4897-8a9d-41ed29c9359d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:05.840040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71748ac-01f1-4897-8a9d-41ed29c9359d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:05.861091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:05.869888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1112/2255] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:32:05 2022] POST /identity/v3/users => generated 284 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:32:05.883699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4df73e-778a-4eb2-bfc3-038cc695f90f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:05.884250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71748ac-01f1-4897-8a9d-41ed29c9359d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:05.889523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:05.890328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.890607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.890880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] PATH_INFO: `/v3/projects/dd5f28b5377f49af82c7cf48093efb36` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.892189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5f28b5377f49af82c7cf48093efb36)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:05.894607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:05.899635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71748ac-01f1-4897-8a9d-41ed29c9359d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:05.907976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336645-7037-4a75-9aad-cf8da2687c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:05.908727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336645-7037-4a75-9aad-cf8da2687c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:05.909287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336645-7037-4a75-9aad-cf8da2687c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:05.909571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336645-7037-4a75-9aad-cf8da2687c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:05.910407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336645-7037-4a75-9aad-cf8da2687c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:05.912027 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336645-7037-4a75-9aad-cf8da2687c8a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:05.924949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1113/2256] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:05.934265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336645-7037-4a75-9aad-cf8da2687c8a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:05.960446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336645-7037-4a75-9aad-cf8da2687c8a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:05.973299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5f28b5377f49af82c7cf48093efb36', 'request_id': 'req-99348d4e-83e7-4630-8bf9-c44c80d24687'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:05.977547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:05.987850 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5f28b5377f49af82c7cf48093efb36', 'request_id': 'req-99348d4e-83e7-4630-8bf9-c44c80d24687'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.010734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5f28b5377f49af82c7cf48093efb36', 'request_id': 'req-99348d4e-83e7-4630-8bf9-c44c80d24687'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.033277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] The token cache is being invalidate because project dd5f28b5377f49af82c7cf48093efb36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:06.033825 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.034540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.039911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1144/2257] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:05 2022] DELETE /identity/v3/projects/dd5f28b5377f49af82c7cf48093efb36 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:06.041635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:06.044053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:06.065768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9151699-4bbd-466b-9389-804806b56e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:06.067067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9151699-4bbd-466b-9389-804806b56e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:06.067395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9151699-4bbd-466b-9389-804806b56e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:06.067683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9151699-4bbd-466b-9389-804806b56e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:06.068726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9151699-4bbd-466b-9389-804806b56e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:06.071838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9151699-4bbd-466b-9389-804806b56e8b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:06.096111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1114/2258] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:06.096111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9151699-4bbd-466b-9389-804806b56e8b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:06.113098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b9151699-4bbd-466b-9389-804806b56e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:06.129170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9151699-4bbd-466b-9389-804806b56e8b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:06.137809 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd60d5f-b4c1-4422-88df-f7edeccb6b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:06.138991 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd60d5f-b4c1-4422-88df-f7edeccb6b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:06.139328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd60d5f-b4c1-4422-88df-f7edeccb6b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:06.139618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd60d5f-b4c1-4422-88df-f7edeccb6b94 admin admin] PATH_INFO: `/v3/projects/42dc938b6443434b9299fd6a28418cf8/users/55fcc3df5683455e99103450ceffb839/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:06.158884 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd60d5f-b4c1-4422-88df-f7edeccb6b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42dc938b6443434b9299fd6a28418cf8, user_id=55fcc3df5683455e99103450ceffb839, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:06.163053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd60d5f-b4c1-4422-88df-f7edeccb6b94 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:06.193231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1115/2259] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:06 2022] PUT /identity/v3/projects/42dc938b6443434b9299fd6a28418cf8/users/55fcc3df5683455e99103450ceffb839/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:06.206688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa4bdb-2581-4bab-8362-97287949906d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:06.207158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa4bdb-2581-4bab-8362-97287949906d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:06.207613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa4bdb-2581-4bab-8362-97287949906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:06.208404 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99348d4e-83e7-4630-8bf9-c44c80d24687 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:06.242194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-86fa4bdb-2581-4bab-8362-97287949906d None None] MFA Rules not processed for user `55fcc3df5683455e99103450ceffb839`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:06.245194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-86fa4bdb-2581-4bab-8362-97287949906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:06.334586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:06.337924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:06.339843 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:06.340337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] PATH_INFO: `/v3/users/426eb73e0e9c448fbb1fa78ad2232364` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:06.346189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=426eb73e0e9c448fbb1fa78ad2232364)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:06.348442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:06.363062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1116/2260] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:06.377578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa4bdb-2581-4bab-8362-97287949906d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:06.379244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-86fa4bdb-2581-4bab-8362-97287949906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:06.450349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '426eb73e0e9c448fbb1fa78ad2232364'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.451985 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '426eb73e0e9c448fbb1fa78ad2232364'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.465124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:06.472168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa4bdb-2581-4bab-8362-97287949906d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:06.472814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '426eb73e0e9c448fbb1fa78ad2232364'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.480957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a4ed0881004eef94166ace450b8a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:06.483632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:06.484334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '426eb73e0e9c448fbb1fa78ad2232364'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.484466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:06.485158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:06.485978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '426eb73e0e9c448fbb1fa78ad2232364'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.488565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:06.506007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1145/2261] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:06 2022] DELETE /identity/v3/users/426eb73e0e9c448fbb1fa78ad2232364 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:06.519315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:06.521410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:06.541414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1117/2262] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:06.676661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:06.678246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:06.691679 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:06.765093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e04c64-3297-4804-a31f-c21b2efe9c9b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:06.770349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:06.771239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:06.771518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:06.771792 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] PATH_INFO: `/v3/users/a949172c43724db19c7011d168c4387e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:06.773070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a949172c43724db19c7011d168c4387e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:06.776040 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:06.839031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a949172c43724db19c7011d168c4387e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.839754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a949172c43724db19c7011d168c4387e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.849512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a949172c43724db19c7011d168c4387e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.857456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a949172c43724db19c7011d168c4387e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.858128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a949172c43724db19c7011d168c4387e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:06.897215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1146/2263] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:06 2022] DELETE /identity/v3/users/a949172c43724db19c7011d168c4387e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:06.929771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:06.931468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:06.949926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf6c10-385b-4a0f-b813-34edc4b82768 service glance] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.026735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.027611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.027892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.028162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] PATH_INFO: `/v3/projects/338e88b1781a4bd5bdbab6e82885ea91` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.029473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=338e88b1781a4bd5bdbab6e82885ea91)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.031546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.112222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.113284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '338e88b1781a4bd5bdbab6e82885ea91', 'request_id': 'req-3a740ff1-f348-4fa9-8796-25dc87320bcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.115132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:07.120250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '338e88b1781a4bd5bdbab6e82885ea91', 'request_id': 'req-3a740ff1-f348-4fa9-8796-25dc87320bcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.132405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23517438-de6c-4d2b-bd08-9e5e8cf2a353 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.133421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '338e88b1781a4bd5bdbab6e82885ea91', 'request_id': 'req-3a740ff1-f348-4fa9-8796-25dc87320bcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.155095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] The token cache is being invalidate because project 338e88b1781a4bd5bdbab6e82885ea91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:07.155414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.156090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3a740ff1-f348-4fa9-8796-25dc87320bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.158015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1118/2264] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:06 2022] DELETE /identity/v3/projects/338e88b1781a4bd5bdbab6e82885ea91 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:07.164645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355df8b-82ea-4b69-99af-6ed4bb9cd30e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.165032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355df8b-82ea-4b69-99af-6ed4bb9cd30e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.165337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355df8b-82ea-4b69-99af-6ed4bb9cd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.185051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6355df8b-82ea-4b69-99af-6ed4bb9cd30e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:07.186292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6355df8b-82ea-4b69-99af-6ed4bb9cd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:07.204248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.205632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.205917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.206198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] PATH_INFO: `/v3/projects/f62678822a4b43b4a5760e06e66dfcc7` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.207802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62678822a4b43b4a5760e06e66dfcc7)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.210082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.243258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:07.248250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1119/2265] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:07.255852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477f21-86be-48c9-9cff-ae79c4d30882 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.256120 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477f21-86be-48c9-9cff-ae79c4d30882 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.256396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477f21-86be-48c9-9cff-ae79c4d30882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.261161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62678822a4b43b4a5760e06e66dfcc7', 'request_id': 'req-22206acd-fe97-4fcb-94f8-c5fb112e5d18'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.266485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62678822a4b43b4a5760e06e66dfcc7', 'request_id': 'req-22206acd-fe97-4fcb-94f8-c5fb112e5d18'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.275247 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62678822a4b43b4a5760e06e66dfcc7', 'request_id': 'req-22206acd-fe97-4fcb-94f8-c5fb112e5d18'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.276215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-51477f21-86be-48c9-9cff-ae79c4d30882 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:07.277457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-51477f21-86be-48c9-9cff-ae79c4d30882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:07.287341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] The token cache is being invalidate because project f62678822a4b43b4a5760e06e66dfcc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:07.287631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.288268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.289940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1147/2266] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:07 2022] DELETE /identity/v3/projects/f62678822a4b43b4a5760e06e66dfcc7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:07.293674 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.294770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:07.294965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:07.353514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1120/2267] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:07.357862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477f21-86be-48c9-9cff-ae79c4d30882 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.367575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477f21-86be-48c9-9cff-ae79c4d30882 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.370593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22206acd-fe97-4fcb-94f8-c5fb112e5d18 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.374039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359cd90-92ee-4107-9eda-155b362b25ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.374743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359cd90-92ee-4107-9eda-155b362b25ba admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.375032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359cd90-92ee-4107-9eda-155b362b25ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.375299 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359cd90-92ee-4107-9eda-155b362b25ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.376134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359cd90-92ee-4107-9eda-155b362b25ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:32:07.376487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359cd90-92ee-4107-9eda-155b362b25ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.377503 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.378182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359cd90-92ee-4107-9eda-155b362b25ba admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.378509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.378800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.379816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] PATH_INFO: `/v3/users/cab9b0e109af430d8e2be3ce219a673b` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.384459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab9b0e109af430d8e2be3ce219a673b)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.386471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.392554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1121/2268] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:32:07.396971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359cd90-92ee-4107-9eda-155b362b25ba admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.412193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359cd90-92ee-4107-9eda-155b362b25ba admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.418262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c901e-bac6-4a3c-a7e9-fa57f7bd44ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.418968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c901e-bac6-4a3c-a7e9-fa57f7bd44ca admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.419221 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c901e-bac6-4a3c-a7e9-fa57f7bd44ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.419512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c901e-bac6-4a3c-a7e9-fa57f7bd44ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.420220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c901e-bac6-4a3c-a7e9-fa57f7bd44ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.423787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c901e-bac6-4a3c-a7e9-fa57f7bd44ca admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.448651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab9b0e109af430d8e2be3ce219a673b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.449269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab9b0e109af430d8e2be3ce219a673b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.456927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1122/2269] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:32:07 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:07.456927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c901e-bac6-4a3c-a7e9-fa57f7bd44ca admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.457332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-194c901e-bac6-4a3c-a7e9-fa57f7bd44ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:07.458381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab9b0e109af430d8e2be3ce219a673b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.466417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab9b0e109af430d8e2be3ce219a673b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.467125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab9b0e109af430d8e2be3ce219a673b'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.494021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1148/2270] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:07 2022] DELETE /identity/v3/users/cab9b0e109af430d8e2be3ce219a673b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:07.494837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.496206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:07.528231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c901e-bac6-4a3c-a7e9-fa57f7bd44ca admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.556111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:07.615226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f96d5b-01db-4bf7-921d-10ae850c63e6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.627904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562b649-70c3-4d9b-afff-ea0b67406070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.628654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b649-70c3-4d9b-afff-ea0b67406070 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.628977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b649-70c3-4d9b-afff-ea0b67406070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.629246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b649-70c3-4d9b-afff-ea0b67406070 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.630018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562b649-70c3-4d9b-afff-ea0b67406070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.633882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562b649-70c3-4d9b-afff-ea0b67406070 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.668549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1149/2271] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:32:07 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:07.675141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562b649-70c3-4d9b-afff-ea0b67406070 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.682861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.684174 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.684607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.684892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] PATH_INFO: `/v3/users/aca6d03ec369454caeb9926c3f9bfcb8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.688440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca6d03ec369454caeb9926c3f9bfcb8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.691722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.699651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562b649-70c3-4d9b-afff-ea0b67406070 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.705461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b05f7-33ed-40ae-9cb4-d305ef7932cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.706308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b05f7-33ed-40ae-9cb4-d305ef7932cb admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.706691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b05f7-33ed-40ae-9cb4-d305ef7932cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.706878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b05f7-33ed-40ae-9cb4-d305ef7932cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.707854 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b05f7-33ed-40ae-9cb4-d305ef7932cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.709914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b05f7-33ed-40ae-9cb4-d305ef7932cb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.727067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1150/2272] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:32:07.728194 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b05f7-33ed-40ae-9cb4-d305ef7932cb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.759327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b05f7-33ed-40ae-9cb4-d305ef7932cb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.766734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71952-1689-4b9f-a140-f36ced662a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.767625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71952-1689-4b9f-a140-f36ced662a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.768011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71952-1689-4b9f-a140-f36ced662a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.768385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da71952-1689-4b9f-a140-f36ced662a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.769161 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da71952-1689-4b9f-a140-f36ced662a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.770801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da71952-1689-4b9f-a140-f36ced662a71 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.779172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:07.798230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1151/2273] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:07.798230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71952-1689-4b9f-a140-f36ced662a71 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.800103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca6d03ec369454caeb9926c3f9bfcb8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.801613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca6d03ec369454caeb9926c3f9bfcb8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.803072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca6d03ec369454caeb9926c3f9bfcb8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.805759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2da71952-1689-4b9f-a140-f36ced662a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:07.823295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da71952-1689-4b9f-a140-f36ced662a71 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:07.828964 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:07.830146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.830502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.830755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] PATH_INFO: `/v3/projects/ae188b49bad448f2abeec557f80f0738` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.832093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae188b49bad448f2abeec557f80f0738)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:07.834207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:07.840045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca6d03ec369454caeb9926c3f9bfcb8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.849452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca6d03ec369454caeb9926c3f9bfcb8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.869165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1123/2274] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:07 2022] DELETE /identity/v3/users/aca6d03ec369454caeb9926c3f9bfcb8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:07.869939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:07.871310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:07.905484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae188b49bad448f2abeec557f80f0738', 'request_id': 'req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.923817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae188b49bad448f2abeec557f80f0738', 'request_id': 'req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.938751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae188b49bad448f2abeec557f80f0738', 'request_id': 'req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.955707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] The token cache is being invalidate because project ae188b49bad448f2abeec557f80f0738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:07.956817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.957708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-60b14a8b-a5e5-4959-abc1-d8c7b05d7958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:07.965346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1152/2275] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:07 2022] DELETE /identity/v3/projects/ae188b49bad448f2abeec557f80f0738 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:07.967485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab8fef-5d30-4ef8-8e19-f49fe90f09cb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:07.967782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab8fef-5d30-4ef8-8e19-f49fe90f09cb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:07.981721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab8fef-5d30-4ef8-8e19-f49fe90f09cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:07.996705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97170e-005d-43c6-9027-1571f4b7631e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.033146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e6ab8fef-5d30-4ef8-8e19-f49fe90f09cb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:08.035464 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e6ab8fef-5d30-4ef8-8e19-f49fe90f09cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.093004 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74837bde-5ed2-4766-a467-f0bda743345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.094258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74837bde-5ed2-4766-a467-f0bda743345a admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.094544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74837bde-5ed2-4766-a467-f0bda743345a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.094871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74837bde-5ed2-4766-a467-f0bda743345a admin admin] PATH_INFO: `/v3/projects/03ad91e147d042f4a5af78bb6cd526dc/users/112be83e8ec24edebda27768aa90a454/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.119866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1153/2276] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:08.121307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785301-a315-416b-9201-64fc23b4ff89 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.121591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785301-a315-416b-9201-64fc23b4ff89 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.121909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41785301-a315-416b-9201-64fc23b4ff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.136397 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74837bde-5ed2-4766-a467-f0bda743345a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ad91e147d042f4a5af78bb6cd526dc, user_id=112be83e8ec24edebda27768aa90a454, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.139459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74837bde-5ed2-4766-a467-f0bda743345a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.167178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1124/2277] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:07 2022] PUT /identity/v3/projects/03ad91e147d042f4a5af78bb6cd526dc/users/112be83e8ec24edebda27768aa90a454/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:08.167899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74837bde-5ed2-4766-a467-f0bda743345a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.170049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-74837bde-5ed2-4766-a467-f0bda743345a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.178027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-41785301-a315-416b-9201-64fc23b4ff89 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:08.179650 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-41785301-a315-416b-9201-64fc23b4ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.207605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:08.222963 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:08.237959 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74837bde-5ed2-4766-a467-f0bda743345a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.241887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e30184-0333-4492-88f5-b0b5caf351b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.242547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e30184-0333-4492-88f5-b0b5caf351b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.242861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e30184-0333-4492-88f5-b0b5caf351b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.243139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e30184-0333-4492-88f5-b0b5caf351b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.260511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1154/2278] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:08.261893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86c4d8-c572-4636-81b6-8d0ef6542c0d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.262184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86c4d8-c572-4636-81b6-8d0ef6542c0d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.262460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86c4d8-c572-4636-81b6-8d0ef6542c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.294374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3f86c4d8-c572-4636-81b6-8d0ef6542c0d None None] MFA Rules not processed for user `112be83e8ec24edebda27768aa90a454`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:08.295607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3f86c4d8-c572-4636-81b6-8d0ef6542c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.310939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e30184-0333-4492-88f5-b0b5caf351b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.312783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e30184-0333-4492-88f5-b0b5caf351b1 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.323698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1125/2279] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:08.325194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b407226-2acd-4e2e-930d-bf4731343e8d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.325511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b407226-2acd-4e2e-930d-bf4731343e8d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.325786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b407226-2acd-4e2e-930d-bf4731343e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.348575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8b407226-2acd-4e2e-930d-bf4731343e8d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:08.349878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8b407226-2acd-4e2e-930d-bf4731343e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.359424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1126/2280] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:08.364516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b407226-2acd-4e2e-930d-bf4731343e8d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.376407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1155/2281] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:08.376611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b407226-2acd-4e2e-930d-bf4731343e8d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.381554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adb17e-b788-4631-b7d5-f85ea43f7df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.382239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb17e-b788-4631-b7d5-f85ea43f7df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.382525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb17e-b788-4631-b7d5-f85ea43f7df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.382811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb17e-b788-4631-b7d5-f85ea43f7df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.383700 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adb17e-b788-4631-b7d5-f85ea43f7df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:32:08.384037 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adb17e-b788-4631-b7d5-f85ea43f7df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.384820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86c4d8-c572-4636-81b6-8d0ef6542c0d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.385772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adb17e-b788-4631-b7d5-f85ea43f7df7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.385998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3f86c4d8-c572-4636-81b6-8d0ef6542c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.400461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1127/2282] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:32:08.405450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adb17e-b788-4631-b7d5-f85ea43f7df7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.417544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adb17e-b788-4631-b7d5-f85ea43f7df7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.424412 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931de643-17e6-4a1a-b7fb-35c3fd658ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.425258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931de643-17e6-4a1a-b7fb-35c3fd658ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.425559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931de643-17e6-4a1a-b7fb-35c3fd658ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.425831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931de643-17e6-4a1a-b7fb-35c3fd658ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.427057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931de643-17e6-4a1a-b7fb-35c3fd658ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.430203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931de643-17e6-4a1a-b7fb-35c3fd658ea8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.465343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86c4d8-c572-4636-81b6-8d0ef6542c0d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.469466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1128/2283] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:32:08 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:08.470826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931de643-17e6-4a1a-b7fb-35c3fd658ea8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.540420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ca985-9105-4e9e-82f2-724f31871202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.541566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ca985-9105-4e9e-82f2-724f31871202 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.542019 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ca985-9105-4e9e-82f2-724f31871202 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.542310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ca985-9105-4e9e-82f2-724f31871202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.559712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931de643-17e6-4a1a-b7fb-35c3fd658ea8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.566248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dc166-c9e8-475a-b080-3b49f24ac49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.567148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dc166-c9e8-475a-b080-3b49f24ac49b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.567259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dc166-c9e8-475a-b080-3b49f24ac49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.567741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dc166-c9e8-475a-b080-3b49f24ac49b admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.568514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dc166-c9e8-475a-b080-3b49f24ac49b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.570656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dc166-c9e8-475a-b080-3b49f24ac49b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.578501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:08.596743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1129/2284] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:32:08 2022] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:32:08.601278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dc166-c9e8-475a-b080-3b49f24ac49b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.612881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dc166-c9e8-475a-b080-3b49f24ac49b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.618021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaee77-c559-426b-b409-c6d49393da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.619243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaee77-c559-426b-b409-c6d49393da42 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.619528 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaee77-c559-426b-b409-c6d49393da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.619901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaee77-c559-426b-b409-c6d49393da42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.620529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaee77-c559-426b-b409-c6d49393da42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.621593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ca985-9105-4e9e-82f2-724f31871202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.622218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaee77-c559-426b-b409-c6d49393da42 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.623048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ca985-9105-4e9e-82f2-724f31871202 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.635981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1156/2285] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:32:08.638108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1130/2286] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:08.638647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ca985-9105-4e9e-82f2-724f31871202 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.650909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ca985-9105-4e9e-82f2-724f31871202 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.658933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaee77-c559-426b-b409-c6d49393da42 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.659514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960919-b634-451e-81ff-99157a61c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.660542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960919-b634-451e-81ff-99157a61c8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.660820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960919-b634-451e-81ff-99157a61c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.661042 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-44eaee77-c559-426b-b409-c6d49393da42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.661146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34960919-b634-451e-81ff-99157a61c8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.661937 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960919-b634-451e-81ff-99157a61c8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.663963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34960919-b634-451e-81ff-99157a61c8f0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.677603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaee77-c559-426b-b409-c6d49393da42 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.679699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1157/2287] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:32:08.684112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960919-b634-451e-81ff-99157a61c8f0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.684675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.685611 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.685893 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.686166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] PATH_INFO: `/v3/projects/d5df616c441146b399caf67d835ad738` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.687372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5df616c441146b399caf67d835ad738)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.689352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.697488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34960919-b634-451e-81ff-99157a61c8f0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.702966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c80a7-c699-4ed1-9830-fab1c917a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.704453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c80a7-c699-4ed1-9830-fab1c917a153 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.704894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c80a7-c699-4ed1-9830-fab1c917a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.705175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c80a7-c699-4ed1-9830-fab1c917a153 admin admin] PATH_INFO: `/v3/projects/6f3924cca08b4bfca114cefb3f43ed2b/users/80800c27923f411ea8f5f68bf9bc8a8f/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.723742 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c80a7-c699-4ed1-9830-fab1c917a153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3924cca08b4bfca114cefb3f43ed2b, user_id=80800c27923f411ea8f5f68bf9bc8a8f, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.726562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c80a7-c699-4ed1-9830-fab1c917a153 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.732732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:08.743935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1158/2288] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:08 2022] PUT /identity/v3/projects/6f3924cca08b4bfca114cefb3f43ed2b/users/80800c27923f411ea8f5f68bf9bc8a8f/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:08.756195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721af26-b42e-4e4c-9bb0-637ff5f6a52f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.756683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721af26-b42e-4e4c-9bb0-637ff5f6a52f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.757021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721af26-b42e-4e4c-9bb0-637ff5f6a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.765967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5df616c441146b399caf67d835ad738', 'request_id': 'req-9a12bdb8-779d-486a-b119-17037c2903b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:08.771543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5df616c441146b399caf67d835ad738', 'request_id': 'req-9a12bdb8-779d-486a-b119-17037c2903b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:08.781093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5df616c441146b399caf67d835ad738', 'request_id': 'req-9a12bdb8-779d-486a-b119-17037c2903b2'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:08.793343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6721af26-b42e-4e4c-9bb0-637ff5f6a52f None None] MFA Rules not processed for user `80800c27923f411ea8f5f68bf9bc8a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:08.795026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6721af26-b42e-4e4c-9bb0-637ff5f6a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.800282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] The token cache is being invalidate because project d5df616c441146b399caf67d835ad738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:08.800577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:08.801835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:08.803415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1131/2289] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:08 2022] DELETE /identity/v3/projects/d5df616c441146b399caf67d835ad738 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:08.807382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.809728 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.866835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1159/2290] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:08.871211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721af26-b42e-4e4c-9bb0-637ff5f6a52f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:08.872630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6721af26-b42e-4e4c-9bb0-637ff5f6a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:08.901472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12bdb8-779d-486a-b119-17037c2903b2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.914195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.915245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.916238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.916238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] PATH_INFO: `/v3/users/1687ce17cdab4875a05a2c1291f08374` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.917278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1687ce17cdab4875a05a2c1291f08374)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.919414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:08.953926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721af26-b42e-4e4c-9bb0-637ff5f6a52f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:08.958688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b09ca2-4c4b-4b78-9d77-d2071c2c3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:08.959364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b09ca2-4c4b-4b78-9d77-d2071c2c3e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:08.959641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b09ca2-4c4b-4b78-9d77-d2071c2c3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:08.959918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b09ca2-4c4b-4b78-9d77-d2071c2c3e38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:08.960614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b09ca2-4c4b-4b78-9d77-d2071c2c3e38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:08.974306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b09ca2-4c4b-4b78-9d77-d2071c2c3e38 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:09.009372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1687ce17cdab4875a05a2c1291f08374'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.010033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1687ce17cdab4875a05a2c1291f08374'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.010681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1687ce17cdab4875a05a2c1291f08374'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.011118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1160/2291] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:32:08 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:32:09.015809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b09ca2-4c4b-4b78-9d77-d2071c2c3e38 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:09.018082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d0b09ca2-4c4b-4b78-9d77-d2071c2c3e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:09.031395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:09.042639 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1687ce17cdab4875a05a2c1291f08374'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.051822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1687ce17cdab4875a05a2c1291f08374'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.080490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1132/2292] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:08 2022] DELETE /identity/v3/users/1687ce17cdab4875a05a2c1291f08374 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:09.133352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b09ca2-4c4b-4b78-9d77-d2071c2c3e38 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:09.207844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3526ac-cf5a-4513-99af-bb31cb4c1809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:09.208530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3526ac-cf5a-4513-99af-bb31cb4c1809 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:09.208810 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3526ac-cf5a-4513-99af-bb31cb4c1809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:09.209113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3526ac-cf5a-4513-99af-bb31cb4c1809 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:09.209807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3526ac-cf5a-4513-99af-bb31cb4c1809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:09.211791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3526ac-cf5a-4513-99af-bb31cb4c1809 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:09.256002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:09.256555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1161/2293] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:32:09 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:32:09.272125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a1d24-7e59-42ff-91af-85433dd3533b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:09.278048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe768c6-80cb-4094-8c9f-2f17ac814e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:09.278731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe768c6-80cb-4094-8c9f-2f17ac814e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:09.279011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe768c6-80cb-4094-8c9f-2f17ac814e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:09.279285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe768c6-80cb-4094-8c9f-2f17ac814e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:09.280025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe768c6-80cb-4094-8c9f-2f17ac814e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:09.281954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe768c6-80cb-4094-8c9f-2f17ac814e6a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:09.295139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1133/2294] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:32:09.299693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3526ac-cf5a-4513-99af-bb31cb4c1809 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:09.316128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3526ac-cf5a-4513-99af-bb31cb4c1809 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:09.322008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76728ec6-b07d-4bca-9d40-f3e064ed5e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:09.323222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76728ec6-b07d-4bca-9d40-f3e064ed5e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:09.323663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76728ec6-b07d-4bca-9d40-f3e064ed5e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:09.324450 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76728ec6-b07d-4bca-9d40-f3e064ed5e13 admin admin] PATH_INFO: `/v3/projects/118654e028ed4f568eabb0f135296983/users/a5c665d97e2747cba6e123a8f1518afa/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:09.344108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76728ec6-b07d-4bca-9d40-f3e064ed5e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118654e028ed4f568eabb0f135296983, user_id=a5c665d97e2747cba6e123a8f1518afa, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:09.347425 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76728ec6-b07d-4bca-9d40-f3e064ed5e13 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:09.365022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1162/2295] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:09 2022] PUT /identity/v3/projects/118654e028ed4f568eabb0f135296983/users/a5c665d97e2747cba6e123a8f1518afa/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:09.369687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe768c6-80cb-4094-8c9f-2f17ac814e6a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:09.382332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe768c6-80cb-4094-8c9f-2f17ac814e6a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:09.401460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:09.416684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76728ec6-b07d-4bca-9d40-f3e064ed5e13 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:09.419260 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-76728ec6-b07d-4bca-9d40-f3e064ed5e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:09.449673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec5cf2-5418-43f9-9696-cf0e2e3037fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:09.450433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec5cf2-5418-43f9-9696-cf0e2e3037fe admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:09.450778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec5cf2-5418-43f9-9696-cf0e2e3037fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:09.451055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec5cf2-5418-43f9-9696-cf0e2e3037fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:09.451922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec5cf2-5418-43f9-9696-cf0e2e3037fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:09.454471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec5cf2-5418-43f9-9696-cf0e2e3037fe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:09.465690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1134/2296] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:32:09.470244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec5cf2-5418-43f9-9696-cf0e2e3037fe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:09.481908 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec5cf2-5418-43f9-9696-cf0e2e3037fe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:09.486798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1735b-14ed-4b29-9a7b-8ea1b212b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:09.487684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1735b-14ed-4b29-9a7b-8ea1b212b731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:09.487971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1735b-14ed-4b29-9a7b-8ea1b212b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:09.488249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1735b-14ed-4b29-9a7b-8ea1b212b731 admin admin] PATH_INFO: `/v3/projects/118654e028ed4f568eabb0f135296983/users/a5c665d97e2747cba6e123a8f1518afa/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:09.490232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1735b-14ed-4b29-9a7b-8ea1b212b731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=118654e028ed4f568eabb0f135296983, user_id=a5c665d97e2747cba6e123a8f1518afa, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:09.492899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1735b-14ed-4b29-9a7b-8ea1b212b731 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:09.500688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76728ec6-b07d-4bca-9d40-f3e064ed5e13 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:09.503336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1135/2297] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:09 2022] PUT /identity/v3/projects/118654e028ed4f568eabb0f135296983/users/a5c665d97e2747cba6e123a8f1518afa/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:09.513583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577fcf8-33a6-48fe-9a01-13cb526bea20 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:09.514041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577fcf8-33a6-48fe-9a01-13cb526bea20 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:09.514301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577fcf8-33a6-48fe-9a01-13cb526bea20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:09.528529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:09.542315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f577fcf8-33a6-48fe-9a01-13cb526bea20 None None] MFA Rules not processed for user `a5c665d97e2747cba6e123a8f1518afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:09.543605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f577fcf8-33a6-48fe-9a01-13cb526bea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:09.565070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:09.565948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:09.566223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:09.566491 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] PATH_INFO: `/v3/projects/59890db274b74c3293ed94f3b95ae3ab` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:09.567684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] RBAC: Authorizing `identity:delete_project(project_id=59890db274b74c3293ed94f3b95ae3ab)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:09.569689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:09.617294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1136/2298] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:09.620447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59890db274b74c3293ed94f3b95ae3ab', 'request_id': 'req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.626638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59890db274b74c3293ed94f3b95ae3ab', 'request_id': 'req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.631262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577fcf8-33a6-48fe-9a01-13cb526bea20 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:09.632752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f577fcf8-33a6-48fe-9a01-13cb526bea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:09.635738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59890db274b74c3293ed94f3b95ae3ab', 'request_id': 'req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.647447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] The token cache is being invalidate because project 59890db274b74c3293ed94f3b95ae3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:09.647730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.648385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.650024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1163/2299] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:09 2022] DELETE /identity/v3/projects/59890db274b74c3293ed94f3b95ae3ab => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:09.654026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:09.655364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:09.712559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577fcf8-33a6-48fe-9a01-13cb526bea20 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:09.731200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc10c9-d0f8-4f6e-be0a-4bc2883bb92c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:09.736723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:09.743724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:09.743724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:09.743724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] PATH_INFO: `/v3/users/31e36a080c1448f092f58c9b21c685db` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:09.746585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e36a080c1448f092f58c9b21c685db)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:09.749629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:09.762106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:09.768185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2bbf31-b0f3-4c72-b5c5-2c3c49b99e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:09.769034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bbf31-b0f3-4c72-b5c5-2c3c49b99e9e service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:09.769321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bbf31-b0f3-4c72-b5c5-2c3c49b99e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:09.769652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2bbf31-b0f3-4c72-b5c5-2c3c49b99e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:09.772556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7c2bbf31-b0f3-4c72-b5c5-2c3c49b99e9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:09.802888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e36a080c1448f092f58c9b21c685db'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.803545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e36a080c1448f092f58c9b21c685db'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.812414 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e36a080c1448f092f58c9b21c685db'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.817412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:09.820664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e36a080c1448f092f58c9b21c685db'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.821913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e36a080c1448f092f58c9b21c685db'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:09.835743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bbf31-b0f3-4c72-b5c5-2c3c49b99e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:09.837260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2bbf31-b0f3-4c72-b5c5-2c3c49b99e9e service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:09.842531 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1164/2300] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:09 2022] DELETE /identity/v3/users/31e36a080c1448f092f58c9b21c685db => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:09.847259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1137/2301] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:10.154656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:10.156092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:10.257488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f4304-2dfc-4cb9-9698-46e201e138f5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:10.265779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:10.265779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.265779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.265779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] PATH_INFO: `/v3/projects/7b9d0aac3e184586bbe27fa4c95040fe` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.266141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9d0aac3e184586bbe27fa4c95040fe)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:10.267304 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:10.321475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9d0aac3e184586bbe27fa4c95040fe', 'request_id': 'req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:10.327368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9d0aac3e184586bbe27fa4c95040fe', 'request_id': 'req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:10.337271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9d0aac3e184586bbe27fa4c95040fe', 'request_id': 'req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:10.351527 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] The token cache is being invalidate because project 7b9d0aac3e184586bbe27fa4c95040fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:10.351864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:10.352525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-f6b761c3-f6b5-49e7-ae1b-8004d40dd8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:10.354147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1165/2302] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:10 2022] DELETE /identity/v3/projects/7b9d0aac3e184586bbe27fa4c95040fe => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:10.358852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36321be-92a2-4aeb-8e74-316bcf1cba8a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.359302 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36321be-92a2-4aeb-8e74-316bcf1cba8a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.359534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36321be-92a2-4aeb-8e74-316bcf1cba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.377344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f36321be-92a2-4aeb-8e74-316bcf1cba8a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:10.378565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f36321be-92a2-4aeb-8e74-316bcf1cba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:10.449926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1138/2303] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:10.519833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784cff0-cc8c-4e20-8485-b4e830fda088 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.520358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784cff0-cc8c-4e20-8485-b4e830fda088 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.520358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784cff0-cc8c-4e20-8485-b4e830fda088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.540571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0784cff0-cc8c-4e20-8485-b4e830fda088 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:10.541894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0784cff0-cc8c-4e20-8485-b4e830fda088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:10.551545 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1166/2304] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:10.556351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36321be-92a2-4aeb-8e74-316bcf1cba8a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:10.567180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36321be-92a2-4aeb-8e74-316bcf1cba8a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:10.571945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b754145-ad48-443d-b277-b123666629d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:10.572583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754145-ad48-443d-b277-b123666629d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.572888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754145-ad48-443d-b277-b123666629d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.573163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754145-ad48-443d-b277-b123666629d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.573889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b754145-ad48-443d-b277-b123666629d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:32:10.574190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b754145-ad48-443d-b277-b123666629d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:10.575810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b754145-ad48-443d-b277-b123666629d3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:10.592025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1139/2305] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:32:10.596637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784cff0-cc8c-4e20-8485-b4e830fda088 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:10.606202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784cff0-cc8c-4e20-8485-b4e830fda088 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:10.611245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55743-abab-45fc-9772-0bc8ce0be063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:10.611952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55743-abab-45fc-9772-0bc8ce0be063 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.612236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55743-abab-45fc-9772-0bc8ce0be063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.612512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55743-abab-45fc-9772-0bc8ce0be063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.613228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc55743-abab-45fc-9772-0bc8ce0be063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:10.615144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc55743-abab-45fc-9772-0bc8ce0be063 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:10.643333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1167/2306] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:32:10 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:10.647786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b754145-ad48-443d-b277-b123666629d3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:10.658165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b754145-ad48-443d-b277-b123666629d3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:10.720051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc096a1-f3dd-4c33-b3fa-b9e5b5def790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:10.720737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc096a1-f3dd-4c33-b3fa-b9e5b5def790 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.721049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc096a1-f3dd-4c33-b3fa-b9e5b5def790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.721396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc096a1-f3dd-4c33-b3fa-b9e5b5def790 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.722111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc096a1-f3dd-4c33-b3fa-b9e5b5def790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:10.724074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc096a1-f3dd-4c33-b3fa-b9e5b5def790 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:10.747784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1140/2307] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:32:10 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:10.752087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55743-abab-45fc-9772-0bc8ce0be063 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:10.762745 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55743-abab-45fc-9772-0bc8ce0be063 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:10.768063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e6e0d-bf28-4cfb-ab3d-91becf99a955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:10.768756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e6e0d-bf28-4cfb-ab3d-91becf99a955 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.769075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e6e0d-bf28-4cfb-ab3d-91becf99a955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.769345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e6e0d-bf28-4cfb-ab3d-91becf99a955 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.770128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e6e0d-bf28-4cfb-ab3d-91becf99a955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:10.771682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e6e0d-bf28-4cfb-ab3d-91becf99a955 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:10.782518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1168/2308] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:10.786775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc096a1-f3dd-4c33-b3fa-b9e5b5def790 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:10.797043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc096a1-f3dd-4c33-b3fa-b9e5b5def790 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:10.801659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba0ca2-9c86-441c-94e8-f21cba7e8700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:10.802322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0ca2-9c86-441c-94e8-f21cba7e8700 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.802614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0ca2-9c86-441c-94e8-f21cba7e8700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.802869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba0ca2-9c86-441c-94e8-f21cba7e8700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.803590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba0ca2-9c86-441c-94e8-f21cba7e8700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:10.805239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba0ca2-9c86-441c-94e8-f21cba7e8700 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:10.815591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1141/2309] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:10.820024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e6e0d-bf28-4cfb-ab3d-91becf99a955 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:10.830767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e6e0d-bf28-4cfb-ab3d-91becf99a955 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:10.836076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629c4a6-176f-438c-a10f-7aace809d35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:10.837031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629c4a6-176f-438c-a10f-7aace809d35a admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.837315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629c4a6-176f-438c-a10f-7aace809d35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.837591 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629c4a6-176f-438c-a10f-7aace809d35a admin admin] PATH_INFO: `/v3/projects/e64bf75bb2344c2ebb15817643a0001d/users/6df02792eb3f47be87af62f3a522cad8/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.854087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629c4a6-176f-438c-a10f-7aace809d35a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64bf75bb2344c2ebb15817643a0001d, user_id=6df02792eb3f47be87af62f3a522cad8, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:10.856875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629c4a6-176f-438c-a10f-7aace809d35a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:10.870905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1169/2310] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:10 2022] PUT /identity/v3/projects/e64bf75bb2344c2ebb15817643a0001d/users/6df02792eb3f47be87af62f3a522cad8/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:10.876337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c34979-4b28-4025-89cd-54ea9876d552 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:10.876622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c34979-4b28-4025-89cd-54ea9876d552 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:10.876975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c34979-4b28-4025-89cd-54ea9876d552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:10.889854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:10.896070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-72c34979-4b28-4025-89cd-54ea9876d552 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:10.897807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-72c34979-4b28-4025-89cd-54ea9876d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:10.960240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1142/2311] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:10.973390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629c4a6-176f-438c-a10f-7aace809d35a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:10.975547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8629c4a6-176f-438c-a10f-7aace809d35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:10.981181 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:11.039098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629c4a6-176f-438c-a10f-7aace809d35a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:11.042734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae73a8-92f9-4fee-8a1b-bcb97c5b5678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:11.043388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae73a8-92f9-4fee-8a1b-bcb97c5b5678 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:11.043669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae73a8-92f9-4fee-8a1b-bcb97c5b5678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:11.043950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae73a8-92f9-4fee-8a1b-bcb97c5b5678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:11.053285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae73a8-92f9-4fee-8a1b-bcb97c5b5678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:11.054773 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae73a8-92f9-4fee-8a1b-bcb97c5b5678 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:11.065083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1170/2312] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:11.367718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c34979-4b28-4025-89cd-54ea9876d552 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:11.369768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-72c34979-4b28-4025-89cd-54ea9876d552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:11.388034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c34979-4b28-4025-89cd-54ea9876d552 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:11.395805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:11.396834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:11.397270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:11.397735 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] PATH_INFO: `/v3/users/112be83e8ec24edebda27768aa90a454` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:11.399702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=112be83e8ec24edebda27768aa90a454)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:11.403298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:11.504474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112be83e8ec24edebda27768aa90a454'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:11.505285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112be83e8ec24edebda27768aa90a454'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:11.505888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112be83e8ec24edebda27768aa90a454'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:11.529628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112be83e8ec24edebda27768aa90a454'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:11.540548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112be83e8ec24edebda27768aa90a454'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:11.561695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1143/2313] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:11 2022] DELETE /identity/v3/users/112be83e8ec24edebda27768aa90a454 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:11.566672 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60ae0d-66b9-4128-85e2-b2f3b3799db7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:11.567191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60ae0d-66b9-4128-85e2-b2f3b3799db7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:11.567300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60ae0d-66b9-4128-85e2-b2f3b3799db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:11.599945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fb60ae0d-66b9-4128-85e2-b2f3b3799db7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:11.601730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fb60ae0d-66b9-4128-85e2-b2f3b3799db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:11.699325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1171/2314] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:11.710515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:11.712782 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:11.783900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c1d59-df79-4143-9109-e5935cebd4fd admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:11.787303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd0014-7979-4d24-b262-19fd3d5299a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:11.788094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd0014-7979-4d24-b262-19fd3d5299a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:11.788478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd0014-7979-4d24-b262-19fd3d5299a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:11.789144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd0014-7979-4d24-b262-19fd3d5299a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:11.799224 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd0014-7979-4d24-b262-19fd3d5299a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:11.800872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd0014-7979-4d24-b262-19fd3d5299a7 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:11.809765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300c87-b66d-405a-8b81-e773f7e55db3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:11.810057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300c87-b66d-405a-8b81-e773f7e55db3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:11.810336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300c87-b66d-405a-8b81-e773f7e55db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:11.813013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1144/2315] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:11.838335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-11300c87-b66d-405a-8b81-e773f7e55db3 None None] MFA Rules not processed for user `6df02792eb3f47be87af62f3a522cad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:11.839602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-11300c87-b66d-405a-8b81-e773f7e55db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:11.928242 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1172/2316] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:11.936065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd0014-7979-4d24-b262-19fd3d5299a7 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:11.937814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-edbd0014-7979-4d24-b262-19fd3d5299a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:11.975828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:12.019220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd0014-7979-4d24-b262-19fd3d5299a7 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.024403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695d9d3-22c3-4f29-bf5e-bf7b07b2fdf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.025440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695d9d3-22c3-4f29-bf5e-bf7b07b2fdf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.025995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695d9d3-22c3-4f29-bf5e-bf7b07b2fdf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.026543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695d9d3-22c3-4f29-bf5e-bf7b07b2fdf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.039100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695d9d3-22c3-4f29-bf5e-bf7b07b2fdf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:12.040831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695d9d3-22c3-4f29-bf5e-bf7b07b2fdf2 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:12.055651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1145/2317] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:12.160095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11300c87-b66d-405a-8b81-e773f7e55db3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.161648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-11300c87-b66d-405a-8b81-e773f7e55db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:12.176171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11300c87-b66d-405a-8b81-e773f7e55db3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.181086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.182006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.182244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.182518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] PATH_INFO: `/v3/projects/03ad91e147d042f4a5af78bb6cd526dc` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.183723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ad91e147d042f4a5af78bb6cd526dc)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:12.185986 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:12.225221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:12.241456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ad91e147d042f4a5af78bb6cd526dc', 'request_id': 'req-8bcb2096-3778-4a07-81e9-c74c911278eb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.247245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ad91e147d042f4a5af78bb6cd526dc', 'request_id': 'req-8bcb2096-3778-4a07-81e9-c74c911278eb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.256219 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ad91e147d042f4a5af78bb6cd526dc', 'request_id': 'req-8bcb2096-3778-4a07-81e9-c74c911278eb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.268135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] The token cache is being invalidate because project 03ad91e147d042f4a5af78bb6cd526dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:12.268420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.269235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8bcb2096-3778-4a07-81e9-c74c911278eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.270659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1173/2318] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:12 2022] DELETE /identity/v3/projects/03ad91e147d042f4a5af78bb6cd526dc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:12.275895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d5a0e-8e0c-462d-a462-17c5f033c1db None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.276220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d5a0e-8e0c-462d-a462-17c5f033c1db None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.276501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d5a0e-8e0c-462d-a462-17c5f033c1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.297459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-435d5a0e-8e0c-462d-a462-17c5f033c1db None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:12.298634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-435d5a0e-8e0c-462d-a462-17c5f033c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:12.379060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1146/2319] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:12.392428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab834c8-70fd-43ac-9fa8-e47e7981c498 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.393087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab834c8-70fd-43ac-9fa8-e47e7981c498 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.393364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab834c8-70fd-43ac-9fa8-e47e7981c498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.412938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9ab834c8-70fd-43ac-9fa8-e47e7981c498 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:12.414248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9ab834c8-70fd-43ac-9fa8-e47e7981c498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:12.422910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1174/2320] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:12.427538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d5a0e-8e0c-462d-a462-17c5f033c1db None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.438077 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d5a0e-8e0c-462d-a462-17c5f033c1db None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.442832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.443489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.443765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.444034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.444762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:32:12.445108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:12.446743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:12.459538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1147/2321] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:32:12.463975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab834c8-70fd-43ac-9fa8-e47e7981c498 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.473498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab834c8-70fd-43ac-9fa8-e47e7981c498 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.478210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d0a17-2d6f-49a6-a6d1-2d43c236acf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.478902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d0a17-2d6f-49a6-a6d1-2d43c236acf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.479206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d0a17-2d6f-49a6-a6d1-2d43c236acf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.479483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d0a17-2d6f-49a6-a6d1-2d43c236acf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.480289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d0a17-2d6f-49a6-a6d1-2d43c236acf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:12.482255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d0a17-2d6f-49a6-a6d1-2d43c236acf0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:12.503600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.505871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:12.513738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1175/2322] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:32:12 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:12.518226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d0a17-2d6f-49a6-a6d1-2d43c236acf0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.520032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac393a48-4bf4-4226-88b7-173ffd715584 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.579179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.580069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.580350 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.580626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] PATH_INFO: `/v3/users/80800c27923f411ea8f5f68bf9bc8a8f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.581869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80800c27923f411ea8f5f68bf9bc8a8f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:12.583834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:12.592959 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d0a17-2d6f-49a6-a6d1-2d43c236acf0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.598989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216441c-9d49-41ce-80ab-8a0533d42b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.599669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216441c-9d49-41ce-80ab-8a0533d42b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.599954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216441c-9d49-41ce-80ab-8a0533d42b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.600232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216441c-9d49-41ce-80ab-8a0533d42b71 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.600958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216441c-9d49-41ce-80ab-8a0533d42b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:12.602932 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216441c-9d49-41ce-80ab-8a0533d42b71 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:12.628296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1176/2323] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:32:12 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:12.629537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216441c-9d49-41ce-80ab-8a0533d42b71 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.633705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80800c27923f411ea8f5f68bf9bc8a8f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.634367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80800c27923f411ea8f5f68bf9bc8a8f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.635003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80800c27923f411ea8f5f68bf9bc8a8f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.639568 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216441c-9d49-41ce-80ab-8a0533d42b71 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.640217 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:12.644943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5989f0-fb0c-4649-8914-af539358c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.645625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5989f0-fb0c-4649-8914-af539358c3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.645899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5989f0-fb0c-4649-8914-af539358c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.646179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5989f0-fb0c-4649-8914-af539358c3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.646904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5989f0-fb0c-4649-8914-af539358c3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:12.648523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5989f0-fb0c-4649-8914-af539358c3ab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:12.648649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80800c27923f411ea8f5f68bf9bc8a8f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.655461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-194fc6b1-cf11-4d37-81c7-70c534eedef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80800c27923f411ea8f5f68bf9bc8a8f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:12.661721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1177/2324] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:12.662755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5989f0-fb0c-4649-8914-af539358c3ab admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.664680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3a5989f0-fb0c-4649-8914-af539358c3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:12.678144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1148/2325] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:12 2022] DELETE /identity/v3/users/80800c27923f411ea8f5f68bf9bc8a8f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:12.681317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5989f0-fb0c-4649-8914-af539358c3ab admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.682245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfdacc-a243-474b-9a0f-876dfb9be934 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.682563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfdacc-a243-474b-9a0f-876dfb9be934 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.682844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfdacc-a243-474b-9a0f-876dfb9be934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.701085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-16bfdacc-a243-474b-9a0f-876dfb9be934 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:12.702374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-16bfdacc-a243-474b-9a0f-876dfb9be934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:12.756421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f9ef-1ac6-4a65-97d0-df4b549b2c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.757156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f9ef-1ac6-4a65-97d0-df4b549b2c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.757437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f9ef-1ac6-4a65-97d0-df4b549b2c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.757707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745f9ef-1ac6-4a65-97d0-df4b549b2c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.758435 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745f9ef-1ac6-4a65-97d0-df4b549b2c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:12.760252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e745f9ef-1ac6-4a65-97d0-df4b549b2c1c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:12.772587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1178/2326] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:32:12.776764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f9ef-1ac6-4a65-97d0-df4b549b2c1c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.784148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:12.789023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e745f9ef-1ac6-4a65-97d0-df4b549b2c1c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.795846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1223226-a274-46c3-9ea4-b4c726b1c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.797089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1223226-a274-46c3-9ea4-b4c726b1c113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.797826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1223226-a274-46c3-9ea4-b4c726b1c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.798116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1223226-a274-46c3-9ea4-b4c726b1c113 admin admin] PATH_INFO: `/v3/projects/dfa850fe725548ddaed337157d3c40df/users/74ebbf2f20d343b284fb41c1b15d4563/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.803010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1149/2327] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:12.809993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfdacc-a243-474b-9a0f-876dfb9be934 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.812431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-16bfdacc-a243-474b-9a0f-876dfb9be934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:12.831480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1223226-a274-46c3-9ea4-b4c726b1c113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa850fe725548ddaed337157d3c40df, user_id=74ebbf2f20d343b284fb41c1b15d4563, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:12.834665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1223226-a274-46c3-9ea4-b4c726b1c113 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:12.851867 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1179/2328] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:12 2022] PUT /identity/v3/projects/dfa850fe725548ddaed337157d3c40df/users/74ebbf2f20d343b284fb41c1b15d4563/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:12.863056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd033-bee2-4252-993c-ea15b18ca2b7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.863469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd033-bee2-4252-993c-ea15b18ca2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.863757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cd033-bee2-4252-993c-ea15b18ca2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.877528 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfdacc-a243-474b-9a0f-876dfb9be934 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:12.892372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-7c9cd033-bee2-4252-993c-ea15b18ca2b7 None None] MFA Rules not processed for user `74ebbf2f20d343b284fb41c1b15d4563`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:12.893701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7c9cd033-bee2-4252-993c-ea15b18ca2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:12.932638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f8bcc-577d-44fa-bfac-f6c489d4ac48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:12.933458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f8bcc-577d-44fa-bfac-f6c489d4ac48 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:12.933739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f8bcc-577d-44fa-bfac-f6c489d4ac48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:12.934019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f8bcc-577d-44fa-bfac-f6c489d4ac48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:12.979609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1180/2329] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:12.984788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:12.990268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd033-bee2-4252-993c-ea15b18ca2b7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:12.991699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7c9cd033-bee2-4252-993c-ea15b18ca2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:13.005861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f8bcc-577d-44fa-bfac-f6c489d4ac48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:13.007328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f8bcc-577d-44fa-bfac-f6c489d4ac48 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:13.017558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1150/2330] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:32:13.050372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cd033-bee2-4252-993c-ea15b18ca2b7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:13.054614 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba43304-c8fd-4a92-87af-13b95b26d78f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:13.055229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba43304-c8fd-4a92-87af-13b95b26d78f service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:13.055733 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba43304-c8fd-4a92-87af-13b95b26d78f service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:13.055865 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba43304-c8fd-4a92-87af-13b95b26d78f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:13.064812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba43304-c8fd-4a92-87af-13b95b26d78f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:13.066536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba43304-c8fd-4a92-87af-13b95b26d78f service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:13.075896 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1181/2331] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:32:13.313694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f8bcc-577d-44fa-bfac-f6c489d4ac48 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:13.315285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-af7f8bcc-577d-44fa-bfac-f6c489d4ac48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:13.330876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f8bcc-577d-44fa-bfac-f6c489d4ac48 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:13.336988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:13.337988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:13.338413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:13.339175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] PATH_INFO: `/v3/projects/6f3924cca08b4bfca114cefb3f43ed2b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:13.340317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f3924cca08b4bfca114cefb3f43ed2b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:13.342786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:13.409774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f3924cca08b4bfca114cefb3f43ed2b', 'request_id': 'req-5636b07a-bc2a-46e5-9c75-50c83f69a28b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.422886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f3924cca08b4bfca114cefb3f43ed2b', 'request_id': 'req-5636b07a-bc2a-46e5-9c75-50c83f69a28b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.438655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f3924cca08b4bfca114cefb3f43ed2b', 'request_id': 'req-5636b07a-bc2a-46e5-9c75-50c83f69a28b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.457061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] The token cache is being invalidate because project 6f3924cca08b4bfca114cefb3f43ed2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:13.457372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.461757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5636b07a-bc2a-46e5-9c75-50c83f69a28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.467241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1151/2332] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:13 2022] DELETE /identity/v3/projects/6f3924cca08b4bfca114cefb3f43ed2b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:13.469041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba43304-c8fd-4a92-87af-13b95b26d78f service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:13.482184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba43304-c8fd-4a92-87af-13b95b26d78f service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:13.498264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad9bb8-c17b-4e2f-8519-2c21038b3d44 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:13.498622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad9bb8-c17b-4e2f-8519-2c21038b3d44 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:13.498969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad9bb8-c17b-4e2f-8519-2c21038b3d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:13.517368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2cad9bb8-c17b-4e2f-8519-2c21038b3d44 None None] MFA Rules not processed for user `6df02792eb3f47be87af62f3a522cad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:13.518710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2cad9bb8-c17b-4e2f-8519-2c21038b3d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:13.555150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:13.555984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:13.556380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:13.556740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] PATH_INFO: `/v3/users/a5c665d97e2747cba6e123a8f1518afa` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:13.558027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5c665d97e2747cba6e123a8f1518afa)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:13.560143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:13.576019 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:13.582195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1152/2333] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:13.621252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5c665d97e2747cba6e123a8f1518afa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.621961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5c665d97e2747cba6e123a8f1518afa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.630721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5c665d97e2747cba6e123a8f1518afa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.638000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5c665d97e2747cba6e123a8f1518afa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.638659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5c665d97e2747cba6e123a8f1518afa'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:13.657835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1182/2334] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:13 2022] DELETE /identity/v3/users/a5c665d97e2747cba6e123a8f1518afa => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:32:13.854389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad9bb8-c17b-4e2f-8519-2c21038b3d44 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:13.855973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2cad9bb8-c17b-4e2f-8519-2c21038b3d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:13.871458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad9bb8-c17b-4e2f-8519-2c21038b3d44 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:13.934352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:13.935388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:13.935673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:13.935973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] PATH_INFO: `/v3/users/876a2df582804d9d98c86c4ec83c817c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:13.937323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=876a2df582804d9d98c86c4ec83c817c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:13.939384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:13.945981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:13.960758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:13.962966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:13.998622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd4e99-ce73-4d2d-82d6-ce297875a4b9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:14.006121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:14.007915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.008329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.008699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] PATH_INFO: `/v3/projects/118654e028ed4f568eabb0f135296983` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.010166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=118654e028ed4f568eabb0f135296983)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:14.012793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:14.047571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '876a2df582804d9d98c86c4ec83c817c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.049032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '876a2df582804d9d98c86c4ec83c817c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.049439 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '876a2df582804d9d98c86c4ec83c817c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.069499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '876a2df582804d9d98c86c4ec83c817c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.084428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '118654e028ed4f568eabb0f135296983', 'request_id': 'req-5161373f-1838-473e-8d63-a0e621902939'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.088340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e3f962c2-dc73-495f-b433-e8ba73f606f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '876a2df582804d9d98c86c4ec83c817c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.090638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '118654e028ed4f568eabb0f135296983', 'request_id': 'req-5161373f-1838-473e-8d63-a0e621902939'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.111843 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '118654e028ed4f568eabb0f135296983', 'request_id': 'req-5161373f-1838-473e-8d63-a0e621902939'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.112918 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1153/2335] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:13 2022] DELETE /identity/v3/users/876a2df582804d9d98c86c4ec83c817c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:14.123629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee99069-906d-42c9-8568-7967e85bcac3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.124157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee99069-906d-42c9-8568-7967e85bcac3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.124564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee99069-906d-42c9-8568-7967e85bcac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.127908 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] The token cache is being invalidate because project 118654e028ed4f568eabb0f135296983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:14.128202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.129022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5161373f-1838-473e-8d63-a0e621902939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:14.131060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1183/2336] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:13 2022] DELETE /identity/v3/projects/118654e028ed4f568eabb0f135296983 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:14.136721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd143-095c-4ed8-9c9a-ab0613868132 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.137040 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd143-095c-4ed8-9c9a-ab0613868132 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.137325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cd143-095c-4ed8-9c9a-ab0613868132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.148227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1ee99069-906d-42c9-8568-7967e85bcac3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:14.149337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1ee99069-906d-42c9-8568-7967e85bcac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:14.161994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-301cd143-095c-4ed8-9c9a-ab0613868132 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:14.163285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-301cd143-095c-4ed8-9c9a-ab0613868132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:14.220973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1154/2337] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:14.230644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee99069-906d-42c9-8568-7967e85bcac3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:14.232075 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1ee99069-906d-42c9-8568-7967e85bcac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:14.250666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1184/2338] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:14.258838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15e84b-96af-4ead-952c-d58245311876 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.259230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15e84b-96af-4ead-952c-d58245311876 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.259508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15e84b-96af-4ead-952c-d58245311876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.288533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6c15e84b-96af-4ead-952c-d58245311876 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:14.291130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6c15e84b-96af-4ead-952c-d58245311876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:14.301729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1185/2339] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:14.306858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15e84b-96af-4ead-952c-d58245311876 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:14.308238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee99069-906d-42c9-8568-7967e85bcac3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:14.314011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eea2b-da2c-41c7-a91a-25d98e6ed7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:14.314986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eea2b-da2c-41c7-a91a-25d98e6ed7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.326132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eea2b-da2c-41c7-a91a-25d98e6ed7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.326132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eea2b-da2c-41c7-a91a-25d98e6ed7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.329241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15e84b-96af-4ead-952c-d58245311876 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:14.334115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178247-3957-4f07-b4c5-b034501b8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:14.334692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178247-3957-4f07-b4c5-b034501b8859 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.334973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178247-3957-4f07-b4c5-b034501b8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.335239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68178247-3957-4f07-b4c5-b034501b8859 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.335961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178247-3957-4f07-b4c5-b034501b8859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:32:14.336263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178247-3957-4f07-b4c5-b034501b8859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:14.337872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418eea2b-da2c-41c7-a91a-25d98e6ed7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:14.338095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68178247-3957-4f07-b4c5-b034501b8859 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:14.339466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418eea2b-da2c-41c7-a91a-25d98e6ed7f9 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:14.340722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:14.350826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1155/2340] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:32:14.359339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1186/2341] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:32:14.359597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eea2b-da2c-41c7-a91a-25d98e6ed7f9 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:14.369743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eea2b-da2c-41c7-a91a-25d98e6ed7f9 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:14.374729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3593e-448f-4e3a-a54a-a14ce3e65c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:14.375473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3593e-448f-4e3a-a54a-a14ce3e65c1d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.375757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3593e-448f-4e3a-a54a-a14ce3e65c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.376035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3593e-448f-4e3a-a54a-a14ce3e65c1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.376839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3593e-448f-4e3a-a54a-a14ce3e65c1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:14.379829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3593e-448f-4e3a-a54a-a14ce3e65c1d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:14.409816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1156/2342] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:32:14 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:14.413995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178247-3957-4f07-b4c5-b034501b8859 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:14.426407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68178247-3957-4f07-b4c5-b034501b8859 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:14.520262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa8a26-e07b-4925-a636-b231986b2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:14.520507 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8a26-e07b-4925-a636-b231986b2ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.520763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8a26-e07b-4925-a636-b231986b2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.521250 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa8a26-e07b-4925-a636-b231986b2ef0 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.521958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa8a26-e07b-4925-a636-b231986b2ef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:14.524979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa8a26-e07b-4925-a636-b231986b2ef0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:14.576332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1187/2343] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:32:14 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:32:14.577910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3593e-448f-4e3a-a54a-a14ce3e65c1d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:14.592025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3593e-448f-4e3a-a54a-a14ce3e65c1d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:14.597118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5eb5-2833-4b06-98f2-504c4df7a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:14.598007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5eb5-2833-4b06-98f2-504c4df7a0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.598459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5eb5-2833-4b06-98f2-504c4df7a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.599028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b5eb5-2833-4b06-98f2-504c4df7a0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.600031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b5eb5-2833-4b06-98f2-504c4df7a0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:14.601736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b5eb5-2833-4b06-98f2-504c4df7a0c3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:14.605319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:14.624761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1157/2344] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:14.627265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa8a26-e07b-4925-a636-b231986b2ef0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:14.639683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa8a26-e07b-4925-a636-b231986b2ef0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:14.648209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861e791-0220-4e0c-a2a5-291c485c600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:14.648916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e791-0220-4e0c-a2a5-291c485c600c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.649212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e791-0220-4e0c-a2a5-291c485c600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.649549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861e791-0220-4e0c-a2a5-291c485c600c admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.650256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861e791-0220-4e0c-a2a5-291c485c600c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:14.655286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861e791-0220-4e0c-a2a5-291c485c600c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:14.670580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1188/2345] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:14.674644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5eb5-2833-4b06-98f2-504c4df7a0c3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:14.689250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b5eb5-2833-4b06-98f2-504c4df7a0c3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:14.697705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a3c4-3593-48c3-aa06-aecdc4ecf235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:14.698621 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a3c4-3593-48c3-aa06-aecdc4ecf235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.698903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a3c4-3593-48c3-aa06-aecdc4ecf235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.699737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a3c4-3593-48c3-aa06-aecdc4ecf235 admin admin] PATH_INFO: `/v3/projects/7a399303adcc4b59a3353bc5caf4e05c/users/86ad54bbc89949998df660d2eb39bb6c/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.716080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866a3c4-3593-48c3-aa06-aecdc4ecf235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a399303adcc4b59a3353bc5caf4e05c, user_id=86ad54bbc89949998df660d2eb39bb6c, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:14.719286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866a3c4-3593-48c3-aa06-aecdc4ecf235 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:14.745092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1158/2346] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:14 2022] PUT /identity/v3/projects/7a399303adcc4b59a3353bc5caf4e05c/users/86ad54bbc89949998df660d2eb39bb6c/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:14.758963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17651b9-fc93-4963-b4d2-0965530e16f4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.759686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17651b9-fc93-4963-b4d2-0965530e16f4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.760204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17651b9-fc93-4963-b4d2-0965530e16f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.775212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a3c4-3593-48c3-aa06-aecdc4ecf235 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:14.782007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a866a3c4-3593-48c3-aa06-aecdc4ecf235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:14.805072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e17651b9-fc93-4963-b4d2-0965530e16f4 None None] MFA Rules not processed for user `86ad54bbc89949998df660d2eb39bb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:14.806294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e17651b9-fc93-4963-b4d2-0965530e16f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:14.899220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a3c4-3593-48c3-aa06-aecdc4ecf235 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:14.905363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:14.906250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:14.906529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:14.908369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] PATH_INFO: `/v3/projects/85355daee9e040fb8ef53cea3a64d1f9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:14.913604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85355daee9e040fb8ef53cea3a64d1f9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:14.916003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:14.931569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1189/2347] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:14.945928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17651b9-fc93-4963-b4d2-0965530e16f4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:14.947717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e17651b9-fc93-4963-b4d2-0965530e16f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:15.046261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17651b9-fc93-4963-b4d2-0965530e16f4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:15.053670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85355daee9e040fb8ef53cea3a64d1f9', 'request_id': 'req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:15.062008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85355daee9e040fb8ef53cea3a64d1f9', 'request_id': 'req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:15.070326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:15.073738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85355daee9e040fb8ef53cea3a64d1f9', 'request_id': 'req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:15.088590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] The token cache is being invalidate because project 85355daee9e040fb8ef53cea3a64d1f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:15.089016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:15.092746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:15.094836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1159/2348] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:14 2022] DELETE /identity/v3/projects/85355daee9e040fb8ef53cea3a64d1f9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:15.113833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0223b-8ba1-4834-a14a-bf8ae0ac48a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:15.114123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0223b-8ba1-4834-a14a-bf8ae0ac48a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:15.114596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0223b-8ba1-4834-a14a-bf8ae0ac48a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:15.114953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0223b-8ba1-4834-a14a-bf8ae0ac48a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:15.117072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-93d0223b-8ba1-4834-a14a-bf8ae0ac48a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:15.186502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0223b-8ba1-4834-a14a-bf8ae0ac48a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:15.188045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0223b-8ba1-4834-a14a-bf8ae0ac48a3 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:15.199263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1190/2349] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:23.295543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:23.297388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:23.367946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7cf70-ef1d-4b7e-bf06-a2daa80bfee8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:23.374565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:23.376084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:23.376579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:23.377112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] PATH_INFO: `/v3/users/74ebbf2f20d343b284fb41c1b15d4563` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:23.379291 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ebbf2f20d343b284fb41c1b15d4563)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:23.383088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:23.387773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:23.445791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ebbf2f20d343b284fb41c1b15d4563'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:23.446417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ebbf2f20d343b284fb41c1b15d4563'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:23.447030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ebbf2f20d343b284fb41c1b15d4563'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:23.465387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ebbf2f20d343b284fb41c1b15d4563'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:23.473494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ebbf2f20d343b284fb41c1b15d4563'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:23.488388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1160/2350] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:23 2022] DELETE /identity/v3/users/74ebbf2f20d343b284fb41c1b15d4563 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:23.493115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb36a-14f1-4182-87a7-45ac5517643e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:23.493642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb36a-14f1-4182-87a7-45ac5517643e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:23.493735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdb36a-14f1-4182-87a7-45ac5517643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:23.511523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cbcdb36a-14f1-4182-87a7-45ac5517643e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:23.512692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cbcdb36a-14f1-4182-87a7-45ac5517643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:23.583448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1191/2351] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:23.594156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:23.595784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:23.664915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a98ff-21fb-4a0f-b210-addd8cfb8a46 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:23.669168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eee1bf-59af-4077-a704-7f370d2d72d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:23.669835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee1bf-59af-4077-a704-7f370d2d72d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:23.670113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee1bf-59af-4077-a704-7f370d2d72d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:23.670381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eee1bf-59af-4077-a704-7f370d2d72d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:23.681754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eee1bf-59af-4077-a704-7f370d2d72d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:23.683215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eee1bf-59af-4077-a704-7f370d2d72d3 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:23.695005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1161/2352] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:24.075909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb36a-14f1-4182-87a7-45ac5517643e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:24.077373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cbcdb36a-14f1-4182-87a7-45ac5517643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:24.089444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdb36a-14f1-4182-87a7-45ac5517643e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:24.097103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:24.098206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.098487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.098766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] PATH_INFO: `/v3/projects/dfa850fe725548ddaed337157d3c40df` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.100071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa850fe725548ddaed337157d3c40df)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:24.102251 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:24.170407 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa850fe725548ddaed337157d3c40df', 'request_id': 'req-c995531f-2fca-44ab-a418-0f705ac456cc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:24.179720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa850fe725548ddaed337157d3c40df', 'request_id': 'req-c995531f-2fca-44ab-a418-0f705ac456cc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:24.199430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa850fe725548ddaed337157d3c40df', 'request_id': 'req-c995531f-2fca-44ab-a418-0f705ac456cc'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:24.209666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:24.215390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] The token cache is being invalidate because project dfa850fe725548ddaed337157d3c40df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:24.215821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:24.217583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c995531f-2fca-44ab-a418-0f705ac456cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:24.220006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1192/2353] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:24 2022] DELETE /identity/v3/projects/dfa850fe725548ddaed337157d3c40df => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:24.225317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab9f0-258f-48be-811c-1e3fde228d58 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.225720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab9f0-258f-48be-811c-1e3fde228d58 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.226272 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdab9f0-258f-48be-811c-1e3fde228d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.244096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9bdab9f0-258f-48be-811c-1e3fde228d58 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:24.245502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9bdab9f0-258f-48be-811c-1e3fde228d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:24.318353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1162/2354] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:24.328644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8390c-7866-476e-a1fb-b69ad205fae6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.328969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8390c-7866-476e-a1fb-b69ad205fae6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.329248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f8390c-7866-476e-a1fb-b69ad205fae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.350076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-08f8390c-7866-476e-a1fb-b69ad205fae6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:24.351575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-08f8390c-7866-476e-a1fb-b69ad205fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:24.359645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1193/2355] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:24.363955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdab9f0-258f-48be-811c-1e3fde228d58 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:24.377871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdab9f0-258f-48be-811c-1e3fde228d58 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:24.382730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b15c4-00a1-4b11-826d-8797f2e7e586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:24.383682 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b15c4-00a1-4b11-826d-8797f2e7e586 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.383972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b15c4-00a1-4b11-826d-8797f2e7e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.384248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b15c4-00a1-4b11-826d-8797f2e7e586 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.385030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b15c4-00a1-4b11-826d-8797f2e7e586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:32:24.385366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b15c4-00a1-4b11-826d-8797f2e7e586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:24.386997 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b15c4-00a1-4b11-826d-8797f2e7e586 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:24.399247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1163/2356] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:32:24.403582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8390c-7866-476e-a1fb-b69ad205fae6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:24.415346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f8390c-7866-476e-a1fb-b69ad205fae6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:24.420419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e117a-c15d-42d3-98dd-76ae9762fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:24.421206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e117a-c15d-42d3-98dd-76ae9762fac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.421573 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e117a-c15d-42d3-98dd-76ae9762fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.421927 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e117a-c15d-42d3-98dd-76ae9762fac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.422739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e117a-c15d-42d3-98dd-76ae9762fac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:24.424882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e117a-c15d-42d3-98dd-76ae9762fac1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:24.455170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1194/2357] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:32:24 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:32:24.460721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b15c4-00a1-4b11-826d-8797f2e7e586 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:24.471322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b15c4-00a1-4b11-826d-8797f2e7e586 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:24.481093 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:24.535730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d1f80-8d77-4521-8e81-55a0d7ffd94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:24.536429 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d1f80-8d77-4521-8e81-55a0d7ffd94c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.536712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d1f80-8d77-4521-8e81-55a0d7ffd94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.537026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d1f80-8d77-4521-8e81-55a0d7ffd94c admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.537787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d1f80-8d77-4521-8e81-55a0d7ffd94c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:24.539739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d1f80-8d77-4521-8e81-55a0d7ffd94c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:24.563298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1164/2358] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:32:24 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:24.567618 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e117a-c15d-42d3-98dd-76ae9762fac1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:24.578902 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e117a-c15d-42d3-98dd-76ae9762fac1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:24.584342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01810a7-1306-4d64-81ef-b3199fc041ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:24.585063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01810a7-1306-4d64-81ef-b3199fc041ee admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.585343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01810a7-1306-4d64-81ef-b3199fc041ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.585629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01810a7-1306-4d64-81ef-b3199fc041ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.586339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01810a7-1306-4d64-81ef-b3199fc041ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:24.587952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01810a7-1306-4d64-81ef-b3199fc041ee admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:24.603537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1195/2359] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:32:24.608014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d1f80-8d77-4521-8e81-55a0d7ffd94c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:24.618845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d1f80-8d77-4521-8e81-55a0d7ffd94c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:24.624720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d3121-7d2c-4385-839f-cf1dc5aca4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:24.625420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d3121-7d2c-4385-839f-cf1dc5aca4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.625702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d3121-7d2c-4385-839f-cf1dc5aca4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.625973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d3121-7d2c-4385-839f-cf1dc5aca4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.626732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d3121-7d2c-4385-839f-cf1dc5aca4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:24.628334 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d3121-7d2c-4385-839f-cf1dc5aca4c6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:24.638923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1165/2360] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:32:24.643465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01810a7-1306-4d64-81ef-b3199fc041ee admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:24.655498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01810a7-1306-4d64-81ef-b3199fc041ee admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:24.663010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95522257-b60b-4daa-a818-7a76491dc9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:24.663892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95522257-b60b-4daa-a818-7a76491dc9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.664172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95522257-b60b-4daa-a818-7a76491dc9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.664510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95522257-b60b-4daa-a818-7a76491dc9ef admin admin] PATH_INFO: `/v3/projects/2f7ae718379645d4bbbd5e5ecf13ba08/users/42669f0a7545465aa8f9c9cc36303b90/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.685232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95522257-b60b-4daa-a818-7a76491dc9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7ae718379645d4bbbd5e5ecf13ba08, user_id=42669f0a7545465aa8f9c9cc36303b90, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:24.688723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95522257-b60b-4daa-a818-7a76491dc9ef admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:24.709432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1196/2361] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:24 2022] PUT /identity/v3/projects/2f7ae718379645d4bbbd5e5ecf13ba08/users/42669f0a7545465aa8f9c9cc36303b90/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:24.785448 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5648e-6e1a-4408-9c61-2be43231544d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.785803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5648e-6e1a-4408-9c61-2be43231544d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.785965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5648e-6e1a-4408-9c61-2be43231544d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.813158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-50a5648e-6e1a-4408-9c61-2be43231544d None None] MFA Rules not processed for user `42669f0a7545465aa8f9c9cc36303b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:24.814498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-50a5648e-6e1a-4408-9c61-2be43231544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:24.881947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1166/2362] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:24.893723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95522257-b60b-4daa-a818-7a76491dc9ef admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:24.895411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-95522257-b60b-4daa-a818-7a76491dc9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:24.968093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95522257-b60b-4daa-a818-7a76491dc9ef admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:24.973837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323bcc6-d334-48ea-8d15-9e842b3660ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:24.974617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323bcc6-d334-48ea-8d15-9e842b3660ab service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:24.974931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323bcc6-d334-48ea-8d15-9e842b3660ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:24.975201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323bcc6-d334-48ea-8d15-9e842b3660ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:24.984620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323bcc6-d334-48ea-8d15-9e842b3660ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:24.986236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323bcc6-d334-48ea-8d15-9e842b3660ab service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:25.007931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1197/2363] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:29.227659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5648e-6e1a-4408-9c61-2be43231544d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:29.229336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-50a5648e-6e1a-4408-9c61-2be43231544d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:29.300325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5648e-6e1a-4408-9c61-2be43231544d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:29.305112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:29.306012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:29.306319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:29.306590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] PATH_INFO: `/v3/users/86ad54bbc89949998df660d2eb39bb6c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:29.307872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ad54bbc89949998df660d2eb39bb6c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:29.309907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:29.334634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:29.364464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ad54bbc89949998df660d2eb39bb6c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:29.365296 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ad54bbc89949998df660d2eb39bb6c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:29.366074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ad54bbc89949998df660d2eb39bb6c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:29.382894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ad54bbc89949998df660d2eb39bb6c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:29.388117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ad54bbc89949998df660d2eb39bb6c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:29.406355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1167/2364] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:29 2022] DELETE /identity/v3/users/86ad54bbc89949998df660d2eb39bb6c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:29.410947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f300-a470-4dc7-a275-d45034cf37f6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:29.411409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f300-a470-4dc7-a275-d45034cf37f6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:29.411548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744f300-a470-4dc7-a275-d45034cf37f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:29.428819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e744f300-a470-4dc7-a275-d45034cf37f6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:29.430062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e744f300-a470-4dc7-a275-d45034cf37f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:29.506191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1198/2365] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:29.515816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:29.517377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:29.583403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e07de-b338-43d7-abd6-c81d8f32ba71 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:29.587025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0ed1e-9443-4c8d-9408-a0fac2f79408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:29.587676 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0ed1e-9443-4c8d-9408-a0fac2f79408 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:29.587957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0ed1e-9443-4c8d-9408-a0fac2f79408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:29.588225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0ed1e-9443-4c8d-9408-a0fac2f79408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:29.598977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0ed1e-9443-4c8d-9408-a0fac2f79408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:29.600692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0ed1e-9443-4c8d-9408-a0fac2f79408 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:29.623457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1168/2366] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:30.207790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f300-a470-4dc7-a275-d45034cf37f6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:30.209673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e744f300-a470-4dc7-a275-d45034cf37f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:30.235390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744f300-a470-4dc7-a275-d45034cf37f6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:30.246858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:30.248052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:30.248052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:30.248421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] PATH_INFO: `/v3/users/42669f0a7545465aa8f9c9cc36303b90` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:30.251746 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=42669f0a7545465aa8f9c9cc36303b90)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:30.254367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:30.313881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:30.339278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42669f0a7545465aa8f9c9cc36303b90'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.340446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42669f0a7545465aa8f9c9cc36303b90'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.358000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42669f0a7545465aa8f9c9cc36303b90'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.368424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42669f0a7545465aa8f9c9cc36303b90'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.369682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-1544492e-aab3-4f5a-a874-456de52cca0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42669f0a7545465aa8f9c9cc36303b90'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.405847 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1199/2367] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:30 2022] DELETE /identity/v3/users/42669f0a7545465aa8f9c9cc36303b90 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:30.406044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0ed1e-9443-4c8d-9408-a0fac2f79408 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:30.407092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1fe0ed1e-9443-4c8d-9408-a0fac2f79408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:30.412870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a03c6-39e6-4d01-be79-d6ba5cdfe1fb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:30.413315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a03c6-39e6-4d01-be79-d6ba5cdfe1fb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:30.413519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a03c6-39e6-4d01-be79-d6ba5cdfe1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:30.432656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0ed1e-9443-4c8d-9408-a0fac2f79408 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:30.445498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-395a03c6-39e6-4d01-be79-d6ba5cdfe1fb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:30.447144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-395a03c6-39e6-4d01-be79-d6ba5cdfe1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:30.559595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1200/2368] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:30.559826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:30.560635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:30.560953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:30.561233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] PATH_INFO: `/v3/projects/7a399303adcc4b59a3353bc5caf4e05c` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:30.562571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a399303adcc4b59a3353bc5caf4e05c)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:30.564644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:30.582934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a03c6-39e6-4d01-be79-d6ba5cdfe1fb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:30.584368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-395a03c6-39e6-4d01-be79-d6ba5cdfe1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:30.635290 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:30.654393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a399303adcc4b59a3353bc5caf4e05c', 'request_id': 'req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.667437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a399303adcc4b59a3353bc5caf4e05c', 'request_id': 'req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.683062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a399303adcc4b59a3353bc5caf4e05c', 'request_id': 'req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.712084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] The token cache is being invalidate because project 7a399303adcc4b59a3353bc5caf4e05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:30.712485 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.713552 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:30.714589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a03c6-39e6-4d01-be79-d6ba5cdfe1fb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:30.729011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1169/2369] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:30 2022] DELETE /identity/v3/projects/7a399303adcc4b59a3353bc5caf4e05c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:30.813969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f04d29-e3e7-4723-a065-774cfdab7aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:30.814788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f04d29-e3e7-4723-a065-774cfdab7aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:30.815167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f04d29-e3e7-4723-a065-774cfdab7aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:30.815538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f04d29-e3e7-4723-a065-774cfdab7aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:30.820039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a4f04d29-e3e7-4723-a065-774cfdab7aa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:30.856025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:30.948157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f04d29-e3e7-4723-a065-774cfdab7aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:30.949854 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f04d29-e3e7-4723-a065-774cfdab7aa9 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:30.963184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1201/2370] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:31.271967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:31.273450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:31.287581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6ee34-d4c3-4d6d-ac21-d259ee57c3e0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:31.293232 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:31.294187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:31.294538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:31.294913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] PATH_INFO: `/v3/projects/2f7ae718379645d4bbbd5e5ecf13ba08` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:31.296200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7ae718379645d4bbbd5e5ecf13ba08)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:31.298280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:31.355931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7ae718379645d4bbbd5e5ecf13ba08', 'request_id': 'req-503b8422-1059-45bd-91c5-0bd30c76a823'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:31.361527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7ae718379645d4bbbd5e5ecf13ba08', 'request_id': 'req-503b8422-1059-45bd-91c5-0bd30c76a823'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:31.370411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7ae718379645d4bbbd5e5ecf13ba08', 'request_id': 'req-503b8422-1059-45bd-91c5-0bd30c76a823'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:31.386414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] The token cache is being invalidate because project 2f7ae718379645d4bbbd5e5ecf13ba08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:31.386790 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:31.387558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-503b8422-1059-45bd-91c5-0bd30c76a823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:31.390134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1170/2371] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:31 2022] DELETE /identity/v3/projects/2f7ae718379645d4bbbd5e5ecf13ba08 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:32.883740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9da64d-3aff-425f-80aa-125cfe38021b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:32.884647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9da64d-3aff-425f-80aa-125cfe38021b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:32.885125 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9da64d-3aff-425f-80aa-125cfe38021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:32.908946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5a9da64d-3aff-425f-80aa-125cfe38021b None None] MFA Rules not processed for user `6df02792eb3f47be87af62f3a522cad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:32.910280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5a9da64d-3aff-425f-80aa-125cfe38021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:32.974311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1202/2372] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:38.855186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65818-0302-451b-a101-1a49c221dd44 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:38.855741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65818-0302-451b-a101-1a49c221dd44 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:38.855846 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b65818-0302-451b-a101-1a49c221dd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:38.874243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-54b65818-0302-451b-a101-1a49c221dd44 None None] MFA Rules not processed for user `fdc1a110d0924e759024f7cc6fc49738`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:38.875466 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-54b65818-0302-451b-a101-1a49c221dd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:38.930275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1171/2373] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:41.255498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab312f0f-7bb1-4802-b44c-adf2d3de727c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:41.256043 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab312f0f-7bb1-4802-b44c-adf2d3de727c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:41.256149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab312f0f-7bb1-4802-b44c-adf2d3de727c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:41.275069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ab312f0f-7bb1-4802-b44c-adf2d3de727c None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:41.276271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ab312f0f-7bb1-4802-b44c-adf2d3de727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:41.335652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1203/2374] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:32:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:41.381715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65818-0302-451b-a101-1a49c221dd44 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:41.383165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-54b65818-0302-451b-a101-1a49c221dd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:41.457770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:41.466243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b65818-0302-451b-a101-1a49c221dd44 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:41.473978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d405f6-8254-4e45-829f-866c1b31a0a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:41.474738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d405f6-8254-4e45-829f-866c1b31a0a9 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:41.477274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d405f6-8254-4e45-829f-866c1b31a0a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:41.477890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d405f6-8254-4e45-829f-866c1b31a0a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:41.488505 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d405f6-8254-4e45-829f-866c1b31a0a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:41.490431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d405f6-8254-4e45-829f-866c1b31a0a9 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:41.499416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1172/2375] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:32:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:32:42.522479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab312f0f-7bb1-4802-b44c-adf2d3de727c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:42.524665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ab312f0f-7bb1-4802-b44c-adf2d3de727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:42.711189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab312f0f-7bb1-4802-b44c-adf2d3de727c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:42.726524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:42.727881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:42.728372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:42.728839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] PATH_INFO: `/v3/users/55fcc3df5683455e99103450ceffb839` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:42.731816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fcc3df5683455e99103450ceffb839)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:42.737421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:42.757334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:42.855104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fcc3df5683455e99103450ceffb839'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:42.856083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fcc3df5683455e99103450ceffb839'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:42.880873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fcc3df5683455e99103450ceffb839'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:42.889832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fcc3df5683455e99103450ceffb839'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:42.891198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fcc3df5683455e99103450ceffb839'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:42.964647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1204/2376] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:42 2022] DELETE /identity/v3/users/55fcc3df5683455e99103450ceffb839 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:42.965419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186962d-2cd7-4472-809d-78ce4f4d3003 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:42.965871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186962d-2cd7-4472-809d-78ce4f4d3003 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:42.965988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6186962d-2cd7-4472-809d-78ce4f4d3003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:43.011520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6186962d-2cd7-4472-809d-78ce4f4d3003 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:43.013148 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6186962d-2cd7-4472-809d-78ce4f4d3003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:43.174875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1173/2377] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:43.186078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:43.187643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:43.310691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3b7ed-8495-415e-aee1-353218aed822 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:43.322857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9d80-a86a-4e2a-a2ac-be64129c7a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:43.323655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9d80-a86a-4e2a-a2ac-be64129c7a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:43.324035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9d80-a86a-4e2a-a2ac-be64129c7a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:43.324743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9d80-a86a-4e2a-a2ac-be64129c7a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:43.339967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9d80-a86a-4e2a-a2ac-be64129c7a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:43.342113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9d80-a86a-4e2a-a2ac-be64129c7a6e service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:43.356330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1205/2378] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:43.892863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186962d-2cd7-4472-809d-78ce4f4d3003 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:43.894848 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6186962d-2cd7-4472-809d-78ce4f4d3003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:43.923867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6186962d-2cd7-4472-809d-78ce4f4d3003 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:43.938352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:43.941829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:43.942207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:43.943865 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] PATH_INFO: `/v3/projects/42dc938b6443434b9299fd6a28418cf8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:43.946076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] RBAC: Authorizing `identity:delete_project(project_id=42dc938b6443434b9299fd6a28418cf8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:43.948141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:44.049962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42dc938b6443434b9299fd6a28418cf8', 'request_id': 'req-5c0ee539-d00b-40a9-9937-7ce42a45479e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:44.059169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42dc938b6443434b9299fd6a28418cf8', 'request_id': 'req-5c0ee539-d00b-40a9-9937-7ce42a45479e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:44.070025 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42dc938b6443434b9299fd6a28418cf8', 'request_id': 'req-5c0ee539-d00b-40a9-9937-7ce42a45479e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:44.086253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] The token cache is being invalidate because project 42dc938b6443434b9299fd6a28418cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:44.086955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:44.087953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-5c0ee539-d00b-40a9-9937-7ce42a45479e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:44.090949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1174/2379] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:43 2022] DELETE /identity/v3/projects/42dc938b6443434b9299fd6a28418cf8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:44.096102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3678d5a-59e4-40e0-a5e5-714de41547c4 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:44.096603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3678d5a-59e4-40e0-a5e5-714de41547c4 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:44.096706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3678d5a-59e4-40e0-a5e5-714de41547c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:44.120490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a3678d5a-59e4-40e0-a5e5-714de41547c4 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:44.121790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a3678d5a-59e4-40e0-a5e5-714de41547c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:44.204178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1206/2380] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:44.205868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac525583-b1a1-4125-86d3-2ef848c92d4e None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:44.206153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac525583-b1a1-4125-86d3-2ef848c92d4e None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:44.206431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac525583-b1a1-4125-86d3-2ef848c92d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:44.229479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ac525583-b1a1-4125-86d3-2ef848c92d4e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:44.230787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ac525583-b1a1-4125-86d3-2ef848c92d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:44.240278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1175/2381] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:44.248764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3678d5a-59e4-40e0-a5e5-714de41547c4 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:44.265379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3678d5a-59e4-40e0-a5e5-714de41547c4 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:44.270311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b8d3-f881-4555-bacb-07c10f5e25ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:44.271163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b8d3-f881-4555-bacb-07c10f5e25ff admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:44.271456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b8d3-f881-4555-bacb-07c10f5e25ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:44.271735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695b8d3-f881-4555-bacb-07c10f5e25ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:44.278091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695b8d3-f881-4555-bacb-07c10f5e25ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:32:44.278411 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695b8d3-f881-4555-bacb-07c10f5e25ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:44.280123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695b8d3-f881-4555-bacb-07c10f5e25ff admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:44.320383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1207/2382] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:32:44.325341 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac525583-b1a1-4125-86d3-2ef848c92d4e None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:44.338252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac525583-b1a1-4125-86d3-2ef848c92d4e None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:44.348054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35b930-53b6-4643-bb77-d2eb89fc605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:44.348815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35b930-53b6-4643-bb77-d2eb89fc605d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:44.349058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35b930-53b6-4643-bb77-d2eb89fc605d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:44.349343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35b930-53b6-4643-bb77-d2eb89fc605d admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:44.350302 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35b930-53b6-4643-bb77-d2eb89fc605d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:44.354546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35b930-53b6-4643-bb77-d2eb89fc605d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:44.534078 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b8d3-f881-4555-bacb-07c10f5e25ff admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:44.535374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1176/2383] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:32:44 2022] POST /identity/v3/projects => generated 389 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:32:44.599906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695b8d3-f881-4555-bacb-07c10f5e25ff admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:44.604513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:44.745978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de8fdd-979a-4222-b145-60c7c964837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:44.748990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de8fdd-979a-4222-b145-60c7c964837a admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:44.749283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de8fdd-979a-4222-b145-60c7c964837a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:44.749570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de8fdd-979a-4222-b145-60c7c964837a admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:44.750347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de8fdd-979a-4222-b145-60c7c964837a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:44.758778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de8fdd-979a-4222-b145-60c7c964837a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:44.813215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1208/2384] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:32:44 2022] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:32:44.816835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35b930-53b6-4643-bb77-d2eb89fc605d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:44.835380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35b930-53b6-4643-bb77-d2eb89fc605d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:44.840371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b36ba-bd35-4394-bf54-35c46bf3cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:44.841432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b36ba-bd35-4394-bf54-35c46bf3cbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:44.841774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b36ba-bd35-4394-bf54-35c46bf3cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:44.842154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b36ba-bd35-4394-bf54-35c46bf3cbd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:44.843840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b36ba-bd35-4394-bf54-35c46bf3cbd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:44.850550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b36ba-bd35-4394-bf54-35c46bf3cbd8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:44.872575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de8fdd-979a-4222-b145-60c7c964837a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:44.879583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1177/2385] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:32:44.886970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de8fdd-979a-4222-b145-60c7c964837a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:44.893342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e88214-ba1d-463a-9280-161bc7bd736d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:44.894101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e88214-ba1d-463a-9280-161bc7bd736d admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:44.894575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e88214-ba1d-463a-9280-161bc7bd736d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:44.895115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e88214-ba1d-463a-9280-161bc7bd736d admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:44.896264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e88214-ba1d-463a-9280-161bc7bd736d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:44.898212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e88214-ba1d-463a-9280-161bc7bd736d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:44.923524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1209/2386] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:32:44.927736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b36ba-bd35-4394-bf54-35c46bf3cbd8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:44.948984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b36ba-bd35-4394-bf54-35c46bf3cbd8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:44.966213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114307e-9b33-4dfd-a8d6-27a43de9b854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:44.967278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114307e-9b33-4dfd-a8d6-27a43de9b854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:44.967568 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114307e-9b33-4dfd-a8d6-27a43de9b854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:44.967845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114307e-9b33-4dfd-a8d6-27a43de9b854 admin admin] PATH_INFO: `/v3/projects/bf6846206e4b42d3b5047b32b89a2c7a/users/d8cfbbde358d460fa069c98f448c6782/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:45.009820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114307e-9b33-4dfd-a8d6-27a43de9b854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6846206e4b42d3b5047b32b89a2c7a, user_id=d8cfbbde358d460fa069c98f448c6782, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:45.016304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114307e-9b33-4dfd-a8d6-27a43de9b854 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:45.066045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1178/2387] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:32:44 2022] PUT /identity/v3/projects/bf6846206e4b42d3b5047b32b89a2c7a/users/d8cfbbde358d460fa069c98f448c6782/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:45.134769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d77df-7fd2-40ce-bd0c-967ba4337e23 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:45.135370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d77df-7fd2-40ce-bd0c-967ba4337e23 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:45.135370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d77df-7fd2-40ce-bd0c-967ba4337e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:45.194696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8a5d77df-7fd2-40ce-bd0c-967ba4337e23 None None] MFA Rules not processed for user `d8cfbbde358d460fa069c98f448c6782`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:45.196504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8a5d77df-7fd2-40ce-bd0c-967ba4337e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:45.314758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1210/2388] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:45.322076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114307e-9b33-4dfd-a8d6-27a43de9b854 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:45.324173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a114307e-9b33-4dfd-a8d6-27a43de9b854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:45.346191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:45.439329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114307e-9b33-4dfd-a8d6-27a43de9b854 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:45.444573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b12a0-d16f-46e9-bf0a-59620eb814b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:45.446707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b12a0-d16f-46e9-bf0a-59620eb814b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:45.448139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b12a0-d16f-46e9-bf0a-59620eb814b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:45.448432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b12a0-d16f-46e9-bf0a-59620eb814b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:45.469278 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b12a0-d16f-46e9-bf0a-59620eb814b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:45.470760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b12a0-d16f-46e9-bf0a-59620eb814b7 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:45.498817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1179/2389] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:54.972358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d64cc-5737-4eac-8223-a19d2f8b9655 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:54.972832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d64cc-5737-4eac-8223-a19d2f8b9655 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:54.973197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d64cc-5737-4eac-8223-a19d2f8b9655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:55.001597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-884d64cc-5737-4eac-8223-a19d2f8b9655 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:55.003294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-884d64cc-5737-4eac-8223-a19d2f8b9655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:55.094995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:55.099359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1211/2390] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:32:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:55.112061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b12a0-d16f-46e9-bf0a-59620eb814b7 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:55.115267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c50b12a0-d16f-46e9-bf0a-59620eb814b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:55.225766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b12a0-d16f-46e9-bf0a-59620eb814b7 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:55.231154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68d453-5f50-499f-b578-7cd653aed7a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:55.231808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d453-5f50-499f-b578-7cd653aed7a2 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:55.232090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d453-5f50-499f-b578-7cd653aed7a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:55.232364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68d453-5f50-499f-b578-7cd653aed7a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:55.240666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68d453-5f50-499f-b578-7cd653aed7a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:55.242417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc68d453-5f50-499f-b578-7cd653aed7a2 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:55.250831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1180/2391] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:32:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:32:56.632893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d64cc-5737-4eac-8223-a19d2f8b9655 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:56.743258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d64cc-5737-4eac-8223-a19d2f8b9655 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:56.753629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:56.754555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:56.756880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:56.757182 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] PATH_INFO: `/v3/users/d8cfbbde358d460fa069c98f448c6782` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:56.759420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8cfbbde358d460fa069c98f448c6782)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:56.761595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:56.857974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8cfbbde358d460fa069c98f448c6782'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:56.859167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8cfbbde358d460fa069c98f448c6782'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:56.881209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8cfbbde358d460fa069c98f448c6782'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:56.890651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8cfbbde358d460fa069c98f448c6782'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:56.891368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8cfbbde358d460fa069c98f448c6782'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:56.929110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1212/2392] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:32:56 2022] DELETE /identity/v3/users/d8cfbbde358d460fa069c98f448c6782 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:56.930598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360504-267b-4c4c-aeda-f0c8db8e1006 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:56.931054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360504-267b-4c4c-aeda-f0c8db8e1006 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:56.931163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0360504-267b-4c4c-aeda-f0c8db8e1006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:56.987754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b0360504-267b-4c4c-aeda-f0c8db8e1006 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:56.989897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b0360504-267b-4c4c-aeda-f0c8db8e1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:57.090082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:57.107082 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1181/2393] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:57.121931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:57.123647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:57.239085 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:32:57.255156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcba0-91d8-4d07-914e-cfed3d709a5e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:57.270957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1382054-a599-448a-882e-adae4830c170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:57.285497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1382054-a599-448a-882e-adae4830c170 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:57.286116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1382054-a599-448a-882e-adae4830c170 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:57.286670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1382054-a599-448a-882e-adae4830c170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:57.309990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1382054-a599-448a-882e-adae4830c170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:57.313537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1382054-a599-448a-882e-adae4830c170 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:57.323560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1213/2394] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:57.649604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360504-267b-4c4c-aeda-f0c8db8e1006 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:57.651889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b0360504-267b-4c4c-aeda-f0c8db8e1006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:57.684976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0360504-267b-4c4c-aeda-f0c8db8e1006 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:57.691851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:57.693052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:57.693405 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:57.693873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] PATH_INFO: `/v3/projects/bf6846206e4b42d3b5047b32b89a2c7a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:57.695213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6846206e4b42d3b5047b32b89a2c7a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:57.697468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:57.767050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6846206e4b42d3b5047b32b89a2c7a', 'request_id': 'req-c31b2217-6f18-469e-a9e7-04a911205e3d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:57.776931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6846206e4b42d3b5047b32b89a2c7a', 'request_id': 'req-c31b2217-6f18-469e-a9e7-04a911205e3d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:57.787044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6846206e4b42d3b5047b32b89a2c7a', 'request_id': 'req-c31b2217-6f18-469e-a9e7-04a911205e3d'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:57.804660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] The token cache is being invalidate because project bf6846206e4b42d3b5047b32b89a2c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:32:57.805743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:57.806486 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c31b2217-6f18-469e-a9e7-04a911205e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:32:57.808302 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1182/2395] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:32:57 2022] DELETE /identity/v3/projects/bf6846206e4b42d3b5047b32b89a2c7a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:32:58.891668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17829a08-0d13-4472-93bb-cf536cb44efd None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:58.892364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17829a08-0d13-4472-93bb-cf536cb44efd None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:58.892364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17829a08-0d13-4472-93bb-cf536cb44efd None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:58.893907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1214/2396] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:32:58.900442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512910b2-cb36-4c0c-894d-8a3f2757f181 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:58.900992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512910b2-cb36-4c0c-894d-8a3f2757f181 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:58.901089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512910b2-cb36-4c0c-894d-8a3f2757f181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:58.925718 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-512910b2-cb36-4c0c-894d-8a3f2757f181 None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:58.927074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-512910b2-cb36-4c0c-894d-8a3f2757f181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:59.028786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1183/2397] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:59.058565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17829a08-0d13-4472-93bb-cf536cb44efd None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:59.060803 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-17829a08-0d13-4472-93bb-cf536cb44efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:59.148146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17829a08-0d13-4472-93bb-cf536cb44efd None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:59.152823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00002fdc-a8b4-4b3b-8bb8-05f06ef2f2df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a4ed0881004eef94166ace450b8a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:59.154081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002fdc-a8b4-4b3b-8bb8-05f06ef2f2df service glance] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:59.154317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002fdc-a8b4-4b3b-8bb8-05f06ef2f2df service glance] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:59.154610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00002fdc-a8b4-4b3b-8bb8-05f06ef2f2df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:59.165923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00002fdc-a8b4-4b3b-8bb8-05f06ef2f2df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:59.167537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00002fdc-a8b4-4b3b-8bb8-05f06ef2f2df service glance] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:59.187114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1215/2398] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:59.255994 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabdd0e-160a-4637-85d8-3e626e90aa30 None None] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:59.256697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabdd0e-160a-4637-85d8-3e626e90aa30 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:59.257212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabdd0e-160a-4637-85d8-3e626e90aa30 None None] PATH_INFO: `/` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:59.259144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1184/2399] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:32:59.264513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b2ace-5146-4825-8f7c-37fc24aee551 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:59.264802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b2ace-5146-4825-8f7c-37fc24aee551 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:59.265123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b2ace-5146-4825-8f7c-37fc24aee551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:59.288746 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0e3b2ace-5146-4825-8f7c-37fc24aee551 None None] MFA Rules not processed for user `11785acde2f74ad481d1224f2a7fd296`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:59.290761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0e3b2ace-5146-4825-8f7c-37fc24aee551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:59.357602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1216/2400] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:32:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:32:59.369719 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabdd0e-160a-4637-85d8-3e626e90aa30 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:59.371721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-efabdd0e-160a-4637-85d8-3e626e90aa30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:59.390424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabdd0e-160a-4637-85d8-3e626e90aa30 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:59.397010 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f7234-a968-42c8-976b-2b6155f1d6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:59.397811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7234-a968-42c8-976b-2b6155f1d6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:59.398158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7234-a968-42c8-976b-2b6155f1d6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:59.398500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f7234-a968-42c8-976b-2b6155f1d6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:59.407708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f7234-a968-42c8-976b-2b6155f1d6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:59.410494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f7234-a968-42c8-976b-2b6155f1d6f5 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:59.423544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1185/2401] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:32:59.515649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c5e4d-4a3e-4bb7-b45c-d1455003ed9f None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:59.516022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c5e4d-4a3e-4bb7-b45c-d1455003ed9f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:59.516374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c5e4d-4a3e-4bb7-b45c-d1455003ed9f None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:59.518054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1217/2402] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:32:59.523939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20968e3d-b06b-47a2-9d4a-4a75ef8914f0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:59.524436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20968e3d-b06b-47a2-9d4a-4a75ef8914f0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:59.524784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20968e3d-b06b-47a2-9d4a-4a75ef8914f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:59.545534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-20968e3d-b06b-47a2-9d4a-4a75ef8914f0 None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:32:59.546774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-20968e3d-b06b-47a2-9d4a-4a75ef8914f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:32:59.569059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1186/2403] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:32:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:32:59.570029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c5e4d-4a3e-4bb7-b45c-d1455003ed9f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:32:59.581724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c5e4d-4a3e-4bb7-b45c-d1455003ed9f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:32:59.588496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d4498-eb7b-4906-950b-400fde2a3809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:32:59.589617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4498-eb7b-4906-950b-400fde2a3809 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:32:59.590106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4498-eb7b-4906-950b-400fde2a3809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:32:59.590540 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d4498-eb7b-4906-950b-400fde2a3809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:32:59.603579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d4498-eb7b-4906-950b-400fde2a3809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:32:59.605206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d4498-eb7b-4906-950b-400fde2a3809 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:32:59.620701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1218/2404] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:32:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:33:02.325079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b6e51-b0bf-4e20-80b8-286b47dcee73 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:33:02.325662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b6e51-b0bf-4e20-80b8-286b47dcee73 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:33:02.325764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b6e51-b0bf-4e20-80b8-286b47dcee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:33:02.360389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b29b6e51-b0bf-4e20-80b8-286b47dcee73 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:33:02.361823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b29b6e51-b0bf-4e20-80b8-286b47dcee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:33:02.407806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:02.435060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1187/2405] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:33:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:33:02.451100 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d4498-eb7b-4906-950b-400fde2a3809 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:33:02.453281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1e9d4498-eb7b-4906-950b-400fde2a3809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:33:02.533595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d4498-eb7b-4906-950b-400fde2a3809 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:33:02.539068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86306310-78a8-4bd0-84e8-863e44342e2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:33:02.539764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86306310-78a8-4bd0-84e8-863e44342e2f service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:33:02.540049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86306310-78a8-4bd0-84e8-863e44342e2f service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:33:02.540324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86306310-78a8-4bd0-84e8-863e44342e2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:33:02.550923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86306310-78a8-4bd0-84e8-863e44342e2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:33:02.551893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86306310-78a8-4bd0-84e8-863e44342e2f service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:33:02.561587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1219/2406] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:33:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:33:12.018596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3d49a-3615-40b9-9877-348ea5f8d7b3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:33:12.019149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3d49a-3615-40b9-9877-348ea5f8d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:33:12.019149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3d49a-3615-40b9-9877-348ea5f8d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:33:12.037951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7cb3d49a-3615-40b9-9877-348ea5f8d7b3 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:33:12.039393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7cb3d49a-3615-40b9-9877-348ea5f8d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:33:12.053916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1188/2407] 10.222.0.59 () {58 vars in 967 bytes} [Fri Jul 1 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:33:12.067040 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86306310-78a8-4bd0-84e8-863e44342e2f service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:33:12.083135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86306310-78a8-4bd0-84e8-863e44342e2f service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:33:12.089981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89972761-825c-4809-9b82-fa7723d5b57a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:33:12.090638 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89972761-825c-4809-9b82-fa7723d5b57a service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:33:12.090976 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89972761-825c-4809-9b82-fa7723d5b57a service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:33:12.091319 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89972761-825c-4809-9b82-fa7723d5b57a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:33:12.102064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89972761-825c-4809-9b82-fa7723d5b57a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:33:12.103656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89972761-825c-4809-9b82-fa7723d5b57a service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:33:12.108127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:12.112484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1220/2408] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:33:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:33:14.133488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3d49a-3615-40b9-9877-348ea5f8d7b3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:33:14.135035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7cb3d49a-3615-40b9-9877-348ea5f8d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:33:14.206564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3d49a-3615-40b9-9877-348ea5f8d7b3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:33:14.211331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:33:14.212215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:33:14.212494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:33:14.212753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] PATH_INFO: `/v3/users/6df02792eb3f47be87af62f3a522cad8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:33:14.213999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df02792eb3f47be87af62f3a522cad8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:33:14.215937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:33:14.267975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df02792eb3f47be87af62f3a522cad8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.268669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df02792eb3f47be87af62f3a522cad8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.269369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df02792eb3f47be87af62f3a522cad8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.282472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df02792eb3f47be87af62f3a522cad8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.289929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e25df77a-4e75-4046-a9e1-6eb430ce1b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df02792eb3f47be87af62f3a522cad8'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.305161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1189/2409] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:33:14 2022] DELETE /identity/v3/users/6df02792eb3f47be87af62f3a522cad8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:33:14.488987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89972761-825c-4809-9b82-fa7723d5b57a service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:33:14.499872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89972761-825c-4809-9b82-fa7723d5b57a service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:33:14.558027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:33:14.558898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:33:14.559178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:33:14.559452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] PATH_INFO: `/v3/projects/e64bf75bb2344c2ebb15817643a0001d` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:33:14.560648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64bf75bb2344c2ebb15817643a0001d)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:33:14.562692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:33:14.616306 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64bf75bb2344c2ebb15817643a0001d', 'request_id': 'req-88745113-f96f-4174-b779-efe4f626a7ab'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.621571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64bf75bb2344c2ebb15817643a0001d', 'request_id': 'req-88745113-f96f-4174-b779-efe4f626a7ab'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.631622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64bf75bb2344c2ebb15817643a0001d', 'request_id': 'req-88745113-f96f-4174-b779-efe4f626a7ab'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.643322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] The token cache is being invalidate because project e64bf75bb2344c2ebb15817643a0001d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:33:14.643609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.644318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:33:14.646011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1221/2410] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:33:14 2022] DELETE /identity/v3/projects/e64bf75bb2344c2ebb15817643a0001d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:33:21.854522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7534a-fb3e-43d8-b93e-9eaab059ed02 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:33:21.855005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7534a-fb3e-43d8-b93e-9eaab059ed02 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:33:21.855108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7534a-fb3e-43d8-b93e-9eaab059ed02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:33:21.874471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-54f7534a-fb3e-43d8-b93e-9eaab059ed02 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:33:21.875774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-54f7534a-fb3e-43d8-b93e-9eaab059ed02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:33:21.924473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:21.938212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1190/2411] 10.222.0.59 () {58 vars in 967 bytes} [Fri Jul 1 16:33:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:33:21.951269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:33:21.953113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:33:22.029027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88745113-f96f-4174-b779-efe4f626a7ab admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:33:22.034558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c9d89-882c-4d16-8aad-b2964dce7f50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:33:22.035227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c9d89-882c-4d16-8aad-b2964dce7f50 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:33:22.035480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c9d89-882c-4d16-8aad-b2964dce7f50 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:33:22.035759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c9d89-882c-4d16-8aad-b2964dce7f50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:33:22.044030 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c9d89-882c-4d16-8aad-b2964dce7f50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:33:22.045681 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c9d89-882c-4d16-8aad-b2964dce7f50 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:33:22.053767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1222/2412] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:33:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:33:31.936814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:32.050874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:33:55.541966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dbd88-aebf-47f9-989b-7cb82de41617 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:33:55.542540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dbd88-aebf-47f9-989b-7cb82de41617 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:33:55.542540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dbd88-aebf-47f9-989b-7cb82de41617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:33:55.562383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-081dbd88-aebf-47f9-989b-7cb82de41617 None None] MFA Rules not processed for user `fdc1a110d0924e759024f7cc6fc49738`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:33:55.563600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-081dbd88-aebf-47f9-989b-7cb82de41617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:33:55.627265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1191/2413] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:34:04.035590 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c9d89-882c-4d16-8aad-b2964dce7f50 service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:34:04.037096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-365c9d89-882c-4d16-8aad-b2964dce7f50 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:34:04.151355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c9d89-882c-4d16-8aad-b2964dce7f50 service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:34:04.156727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d7c4d-a265-4e31-92da-a3329963609d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:34:04.157478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d7c4d-a265-4e31-92da-a3329963609d service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:34:04.157694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d7c4d-a265-4e31-92da-a3329963609d service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:34:04.157974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d7c4d-a265-4e31-92da-a3329963609d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:34:04.159790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ed6d7c4d-a265-4e31-92da-a3329963609d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:34:04.175940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d7c4d-a265-4e31-92da-a3329963609d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:34:04.177923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d7c4d-a265-4e31-92da-a3329963609d service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:34:04.189183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1223/2414] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:34:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:34:05.619388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=25 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:34:07.536608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56d221-17fd-4ebc-b027-8afcbca2dc1c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:34:07.537253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56d221-17fd-4ebc-b027-8afcbca2dc1c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:34:07.537253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56d221-17fd-4ebc-b027-8afcbca2dc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:34:07.555980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-1a56d221-17fd-4ebc-b027-8afcbca2dc1c None None] MFA Rules not processed for user `94e69d561087490eb018178c3af5bc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:34:07.557306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a56d221-17fd-4ebc-b027-8afcbca2dc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:34:07.616160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1192/2415] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:34:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:34:14.184224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=41 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:34:17.608409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=25 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:34:44.917651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591856ab-6171-478d-9bf6-0e68f8d3aa01 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:34:44.918218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591856ab-6171-478d-9bf6-0e68f8d3aa01 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:34:44.918218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591856ab-6171-478d-9bf6-0e68f8d3aa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:34:44.935989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-591856ab-6171-478d-9bf6-0e68f8d3aa01 None None] MFA Rules not processed for user `5d773059c4b34e3e9c19e8355093266f`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:34:44.937241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-591856ab-6171-478d-9bf6-0e68f8d3aa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:34:44.993731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1224/2416] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:34:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:34:54.986334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=25 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:34:59.471168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56d221-17fd-4ebc-b027-8afcbca2dc1c None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:34:59.472634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1a56d221-17fd-4ebc-b027-8afcbca2dc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:34:59.548213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56d221-17fd-4ebc-b027-8afcbca2dc1c None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:34:59.552772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:34:59.553688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:34:59.553976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:34:59.554238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] PATH_INFO: `/v3/users/fdc1a110d0924e759024f7cc6fc49738` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:34:59.555441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc1a110d0924e759024f7cc6fc49738)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:34:59.557444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:34:59.617144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc1a110d0924e759024f7cc6fc49738'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:34:59.618030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc1a110d0924e759024f7cc6fc49738'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:34:59.618681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc1a110d0924e759024f7cc6fc49738'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:34:59.633773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc1a110d0924e759024f7cc6fc49738'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:34:59.641531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b2adeb35-f47f-4688-9dc3-fe741e8021bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc1a110d0924e759024f7cc6fc49738'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:34:59.659031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1193/2417] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:34:59 2022] DELETE /identity/v3/users/fdc1a110d0924e759024f7cc6fc49738 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:34:59.999112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591856ab-6171-478d-9bf6-0e68f8d3aa01 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:00.012975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591856ab-6171-478d-9bf6-0e68f8d3aa01 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:00.073802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:00.074673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.074956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.075232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] PATH_INFO: `/v3/projects/a0b0a1e579274d26a74b1e9ec4241c8f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.076415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b0a1e579274d26a74b1e9ec4241c8f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:00.078388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:00.127173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b0a1e579274d26a74b1e9ec4241c8f', 'request_id': 'req-86768b20-096f-4fdc-9628-41d7dff8c299'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:00.132800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b0a1e579274d26a74b1e9ec4241c8f', 'request_id': 'req-86768b20-096f-4fdc-9628-41d7dff8c299'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:00.142447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b0a1e579274d26a74b1e9ec4241c8f', 'request_id': 'req-86768b20-096f-4fdc-9628-41d7dff8c299'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:00.154259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] The token cache is being invalidate because project a0b0a1e579274d26a74b1e9ec4241c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:35:00.154546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:00.155310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-86768b20-096f-4fdc-9628-41d7dff8c299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:00.157025 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1225/2418] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:34:59 2022] DELETE /identity/v3/projects/a0b0a1e579274d26a74b1e9ec4241c8f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:35:00.167693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dea79-ba7e-4610-b9e3-5cbdd03a4f22 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.168074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dea79-ba7e-4610-b9e3-5cbdd03a4f22 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.168356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dea79-ba7e-4610-b9e3-5cbdd03a4f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.217327 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a06dea79-ba7e-4610-b9e3-5cbdd03a4f22 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:00.218549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a06dea79-ba7e-4610-b9e3-5cbdd03a4f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:00.276306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:00.290329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1194/2419] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:00.298439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96814e71-597b-416f-8c40-22b8f3a426ae None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.298730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96814e71-597b-416f-8c40-22b8f3a426ae None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.299014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96814e71-597b-416f-8c40-22b8f3a426ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.318546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-96814e71-597b-416f-8c40-22b8f3a426ae None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:00.319757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-96814e71-597b-416f-8c40-22b8f3a426ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:00.328261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1226/2420] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:00.332731 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dea79-ba7e-4610-b9e3-5cbdd03a4f22 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:00.343308 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dea79-ba7e-4610-b9e3-5cbdd03a4f22 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:00.348834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ed939-3d72-45d0-8bee-c0d0466347ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:00.349511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ed939-3d72-45d0-8bee-c0d0466347ab admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.349788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ed939-3d72-45d0-8bee-c0d0466347ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.350057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ed939-3d72-45d0-8bee-c0d0466347ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.350787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ed939-3d72-45d0-8bee-c0d0466347ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:35:00.351090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ed939-3d72-45d0-8bee-c0d0466347ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:00.352708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ed939-3d72-45d0-8bee-c0d0466347ab admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:00.365262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1195/2421] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:35:00.369839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96814e71-597b-416f-8c40-22b8f3a426ae None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:00.379930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96814e71-597b-416f-8c40-22b8f3a426ae None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:00.386365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a48428-63a2-4a94-8e1b-5b49da1ed4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:00.387016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a48428-63a2-4a94-8e1b-5b49da1ed4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.387295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a48428-63a2-4a94-8e1b-5b49da1ed4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.387570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a48428-63a2-4a94-8e1b-5b49da1ed4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.388256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a48428-63a2-4a94-8e1b-5b49da1ed4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:00.390215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a48428-63a2-4a94-8e1b-5b49da1ed4c8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:00.421559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1227/2422] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:35:00 2022] POST /identity/v3/projects => generated 353 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:00.427351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ed939-3d72-45d0-8bee-c0d0466347ab admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:00.437598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ed939-3d72-45d0-8bee-c0d0466347ab admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:00.501469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fb4ce-25ab-4451-a704-5f66a9a2ffcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:00.502145 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fb4ce-25ab-4451-a704-5f66a9a2ffcc admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.502431 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fb4ce-25ab-4451-a704-5f66a9a2ffcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.502709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fb4ce-25ab-4451-a704-5f66a9a2ffcc admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.503403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fb4ce-25ab-4451-a704-5f66a9a2ffcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:00.505456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983fb4ce-25ab-4451-a704-5f66a9a2ffcc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:00.526913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1196/2423] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:35:00 2022] POST /identity/v3/users => generated 277 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:00.531150 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a48428-63a2-4a94-8e1b-5b49da1ed4c8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:00.541756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a48428-63a2-4a94-8e1b-5b49da1ed4c8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:00.546955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124cb90-ca2d-4bd4-9cc4-2cf2798a8eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:00.547617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cb90-ca2d-4bd4-9cc4-2cf2798a8eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.547898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cb90-ca2d-4bd4-9cc4-2cf2798a8eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.548169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124cb90-ca2d-4bd4-9cc4-2cf2798a8eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.548950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124cb90-ca2d-4bd4-9cc4-2cf2798a8eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:00.550555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124cb90-ca2d-4bd4-9cc4-2cf2798a8eb8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:00.562215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1228/2424] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:00.566202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fb4ce-25ab-4451-a704-5f66a9a2ffcc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:00.576383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fb4ce-25ab-4451-a704-5f66a9a2ffcc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:00.581511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7730c9-619b-4390-a942-0f95a0c772b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:00.582195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7730c9-619b-4390-a942-0f95a0c772b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.582477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7730c9-619b-4390-a942-0f95a0c772b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.582850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7730c9-619b-4390-a942-0f95a0c772b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.583587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7730c9-619b-4390-a942-0f95a0c772b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:00.585250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7730c9-619b-4390-a942-0f95a0c772b7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:00.595701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1197/2425] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:00.605311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124cb90-ca2d-4bd4-9cc4-2cf2798a8eb8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:00.616041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124cb90-ca2d-4bd4-9cc4-2cf2798a8eb8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:00.621644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dac37-5b22-45b2-a496-f530d1fee1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:00.622546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dac37-5b22-45b2-a496-f530d1fee1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.622837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dac37-5b22-45b2-a496-f530d1fee1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.623109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dac37-5b22-45b2-a496-f530d1fee1cb admin admin] PATH_INFO: `/v3/projects/cb4edd2d009043158ef457d1b40631ee/users/698c1a66ac784d778355294f961da074/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.637977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dac37-5b22-45b2-a496-f530d1fee1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4edd2d009043158ef457d1b40631ee, user_id=698c1a66ac784d778355294f961da074, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:00.640651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dac37-5b22-45b2-a496-f530d1fee1cb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:00.657931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1229/2426] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:00 2022] PUT /identity/v3/projects/cb4edd2d009043158ef457d1b40631ee/users/698c1a66ac784d778355294f961da074/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:00.672763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509b110-80b8-4ca4-bbae-acf90ca7db68 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.673500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509b110-80b8-4ca4-bbae-acf90ca7db68 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.674300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509b110-80b8-4ca4-bbae-acf90ca7db68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.712675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8509b110-80b8-4ca4-bbae-acf90ca7db68 None None] MFA Rules not processed for user `698c1a66ac784d778355294f961da074`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:00.715002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8509b110-80b8-4ca4-bbae-acf90ca7db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:00.789777 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1198/2427] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:00 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:00.796914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dac37-5b22-45b2-a496-f530d1fee1cb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:00.828331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:00.862657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dac37-5b22-45b2-a496-f530d1fee1cb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:00.867732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69b713-83ff-48e7-8b29-cbd83ad3cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:00.868384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69b713-83ff-48e7-8b29-cbd83ad3cdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.868665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69b713-83ff-48e7-8b29-cbd83ad3cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.868958 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69b713-83ff-48e7-8b29-cbd83ad3cdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.869668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69b713-83ff-48e7-8b29-cbd83ad3cdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:00.871569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69b713-83ff-48e7-8b29-cbd83ad3cdd6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:00.899504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1230/2428] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:35:00 2022] POST /identity/v3/projects => generated 357 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:00.903575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509b110-80b8-4ca4-bbae-acf90ca7db68 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:00.915234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509b110-80b8-4ca4-bbae-acf90ca7db68 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:00.963298 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:00.976385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b895-44e9-4a14-a9c5-bfb348b1c158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:00.977105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b895-44e9-4a14-a9c5-bfb348b1c158 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:00.977382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b895-44e9-4a14-a9c5-bfb348b1c158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:00.977651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836b895-44e9-4a14-a9c5-bfb348b1c158 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:00.978342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836b895-44e9-4a14-a9c5-bfb348b1c158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:00.981329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836b895-44e9-4a14-a9c5-bfb348b1c158 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:01.008664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1199/2429] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:35:00 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:01.012429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69b713-83ff-48e7-8b29-cbd83ad3cdd6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:01.025765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69b713-83ff-48e7-8b29-cbd83ad3cdd6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:01.048629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3134c-6ff8-4434-a858-ce08f9bd802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:01.049660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3134c-6ff8-4434-a858-ce08f9bd802a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:01.050117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3134c-6ff8-4434-a858-ce08f9bd802a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:01.050538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3134c-6ff8-4434-a858-ce08f9bd802a admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:01.051608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3134c-6ff8-4434-a858-ce08f9bd802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:01.053534 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3134c-6ff8-4434-a858-ce08f9bd802a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:01.072366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1231/2430] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:01.076577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b895-44e9-4a14-a9c5-bfb348b1c158 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:01.087866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836b895-44e9-4a14-a9c5-bfb348b1c158 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:01.092972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463abe8-a408-4b91-b3b0-a00aa40bffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:01.094121 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463abe8-a408-4b91-b3b0-a00aa40bffc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:01.094246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463abe8-a408-4b91-b3b0-a00aa40bffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:01.094551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463abe8-a408-4b91-b3b0-a00aa40bffc7 admin admin] PATH_INFO: `/v3/projects/ef36e856509541a68edfb16842f8ef9e/users/3a03565305ef408997dda5aabd77cfcc/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:01.112521 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463abe8-a408-4b91-b3b0-a00aa40bffc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef36e856509541a68edfb16842f8ef9e, user_id=3a03565305ef408997dda5aabd77cfcc, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:01.115504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463abe8-a408-4b91-b3b0-a00aa40bffc7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:01.143741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1200/2431] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:01 2022] PUT /identity/v3/projects/ef36e856509541a68edfb16842f8ef9e/users/3a03565305ef408997dda5aabd77cfcc/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:01.145727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3134c-6ff8-4434-a858-ce08f9bd802a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:01.158876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3134c-6ff8-4434-a858-ce08f9bd802a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:01.221263 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebc36b-dd34-4537-9aab-fac00c0fc9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:01.221707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebc36b-dd34-4537-9aab-fac00c0fc9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:01.221948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebc36b-dd34-4537-9aab-fac00c0fc9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:01.222209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebc36b-dd34-4537-9aab-fac00c0fc9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:01.222933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebc36b-dd34-4537-9aab-fac00c0fc9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:01.224689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebc36b-dd34-4537-9aab-fac00c0fc9b0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:01.235639 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1232/2432] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:01.241235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463abe8-a408-4b91-b3b0-a00aa40bffc7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:01.251803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463abe8-a408-4b91-b3b0-a00aa40bffc7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:01.256420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f29ec-e082-47a0-a522-b4be8a562b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:01.257328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f29ec-e082-47a0-a522-b4be8a562b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:01.257605 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f29ec-e082-47a0-a522-b4be8a562b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:01.257874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f29ec-e082-47a0-a522-b4be8a562b6c admin admin] PATH_INFO: `/v3/projects/ef36e856509541a68edfb16842f8ef9e/users/3a03565305ef408997dda5aabd77cfcc/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:01.259822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f29ec-e082-47a0-a522-b4be8a562b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef36e856509541a68edfb16842f8ef9e, user_id=3a03565305ef408997dda5aabd77cfcc, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:01.262488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f29ec-e082-47a0-a522-b4be8a562b6c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:01.272607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1201/2433] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:01 2022] PUT /identity/v3/projects/ef36e856509541a68edfb16842f8ef9e/users/3a03565305ef408997dda5aabd77cfcc/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:01.282939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335994c4-fecc-41c3-be56-5c2f940252b7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:01.283231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335994c4-fecc-41c3-be56-5c2f940252b7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:01.283509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335994c4-fecc-41c3-be56-5c2f940252b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:01.311156 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-335994c4-fecc-41c3-be56-5c2f940252b7 None None] MFA Rules not processed for user `3a03565305ef408997dda5aabd77cfcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:01.312413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-335994c4-fecc-41c3-be56-5c2f940252b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:01.383604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1233/2434] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:01 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:01.395161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f29ec-e082-47a0-a522-b4be8a562b6c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:01.397190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-560f29ec-e082-47a0-a522-b4be8a562b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:01.485423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f29ec-e082-47a0-a522-b4be8a562b6c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:01.489706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71d3b6-7130-491a-996a-417f98fb448a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:01.490364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71d3b6-7130-491a-996a-417f98fb448a service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:01.490648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71d3b6-7130-491a-996a-417f98fb448a service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:01.490923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71d3b6-7130-491a-996a-417f98fb448a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:01.505197 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71d3b6-7130-491a-996a-417f98fb448a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:01.507090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71d3b6-7130-491a-996a-417f98fb448a service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:01.518404 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1202/2435] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:01 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:01.601844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335994c4-fecc-41c3-be56-5c2f940252b7 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:01.612529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335994c4-fecc-41c3-be56-5c2f940252b7 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:01.617251 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545b24f-d8f6-47fe-98fb-f2d2e16ba5d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:01.617906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545b24f-d8f6-47fe-98fb-f2d2e16ba5d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:01.618292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545b24f-d8f6-47fe-98fb-f2d2e16ba5d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:01.618609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545b24f-d8f6-47fe-98fb-f2d2e16ba5d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:01.638531 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:01.679468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545b24f-d8f6-47fe-98fb-f2d2e16ba5d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:01.680959 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545b24f-d8f6-47fe-98fb-f2d2e16ba5d4 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:01.690261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1234/2436] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:01 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:11.514079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=56,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:11.685972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=18 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:16.708235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71d3b6-7130-491a-996a-417f98fb448a service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:16.772864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71d3b6-7130-491a-996a-417f98fb448a service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:16.777810 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:16.778687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:16.778971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:16.779244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] PATH_INFO: `/v3/users/698c1a66ac784d778355294f961da074` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:16.780481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=698c1a66ac784d778355294f961da074)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:16.782514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:16.844045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698c1a66ac784d778355294f961da074'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:16.845546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698c1a66ac784d778355294f961da074'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:16.846467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698c1a66ac784d778355294f961da074'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:16.866633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698c1a66ac784d778355294f961da074'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:16.877125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698c1a66ac784d778355294f961da074'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:16.892465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1203/2437] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:35:16 2022] DELETE /identity/v3/users/698c1a66ac784d778355294f961da074 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:16.897157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220393-871e-402e-8f93-2b38e32684f6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:16.897646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220393-871e-402e-8f93-2b38e32684f6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:16.897742 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220393-871e-402e-8f93-2b38e32684f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:16.914493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-f1220393-871e-402e-8f93-2b38e32684f6 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:16.915695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f1220393-871e-402e-8f93-2b38e32684f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:16.974990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1235/2438] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:35:16.987865 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:16.990176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:17.051613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aed3c2-2d0e-460f-919f-9e0726beeb70 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:17.055438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332597d-7d66-48ef-9d57-63f2032fb074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:17.056134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332597d-7d66-48ef-9d57-63f2032fb074 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:17.056456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332597d-7d66-48ef-9d57-63f2032fb074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:17.056729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332597d-7d66-48ef-9d57-63f2032fb074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:17.065841 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332597d-7d66-48ef-9d57-63f2032fb074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:17.067280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332597d-7d66-48ef-9d57-63f2032fb074 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:17.076795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1204/2439] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:17.371753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220393-871e-402e-8f93-2b38e32684f6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:17.373581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f1220393-871e-402e-8f93-2b38e32684f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:17.393814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220393-871e-402e-8f93-2b38e32684f6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:17.398617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:17.399500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:17.399780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:17.400127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] PATH_INFO: `/v3/projects/cb4edd2d009043158ef457d1b40631ee` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:17.401351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4edd2d009043158ef457d1b40631ee)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:17.403427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:17.453276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4edd2d009043158ef457d1b40631ee', 'request_id': 'req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.459113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4edd2d009043158ef457d1b40631ee', 'request_id': 'req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.470011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4edd2d009043158ef457d1b40631ee', 'request_id': 'req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.483805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] The token cache is being invalidate because project cb4edd2d009043158ef457d1b40631ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:35:17.484029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.484669 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c9a1d7d8-a02a-4bd8-86b1-1fdc822eb34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.486284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1236/2440] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:35:17 2022] DELETE /identity/v3/projects/cb4edd2d009043158ef457d1b40631ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:17.490344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332597d-7d66-48ef-9d57-63f2032fb074 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:17.500051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332597d-7d66-48ef-9d57-63f2032fb074 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:17.521996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:17.535708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a0ce6-408e-4b95-8ee4-2a1e04498908 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:17.535999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a0ce6-408e-4b95-8ee4-2a1e04498908 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:17.536316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a0ce6-408e-4b95-8ee4-2a1e04498908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:17.564885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:17.565770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:17.566052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:17.566322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] PATH_INFO: `/v3/users/3a03565305ef408997dda5aabd77cfcc` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:17.567502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a03565305ef408997dda5aabd77cfcc)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:17.569479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:17.598123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-728a0ce6-408e-4b95-8ee4-2a1e04498908 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:17.599764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-728a0ce6-408e-4b95-8ee4-2a1e04498908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:17.638827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a03565305ef408997dda5aabd77cfcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.639524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a03565305ef408997dda5aabd77cfcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.640103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a03565305ef408997dda5aabd77cfcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.655972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a03565305ef408997dda5aabd77cfcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.664039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a03565305ef408997dda5aabd77cfcc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:17.683135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1205/2441] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:35:17 2022] DELETE /identity/v3/users/3a03565305ef408997dda5aabd77cfcc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:17.695230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:17.711859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1237/2442] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:35:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:35:17.778905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:17.780467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:17.892797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0a8e0-1efb-48ce-bbf3-21432c776db9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:17.900549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635df84-1b12-4578-afa7-914f51b41932 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:17.901259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635df84-1b12-4578-afa7-914f51b41932 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:17.901540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635df84-1b12-4578-afa7-914f51b41932 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:17.901812 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635df84-1b12-4578-afa7-914f51b41932 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:17.926450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:17.971463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635df84-1b12-4578-afa7-914f51b41932 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:17.973434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635df84-1b12-4578-afa7-914f51b41932 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:17.982141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1206/2443] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:35:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:35:18.061209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a0ce6-408e-4b95-8ee4-2a1e04498908 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:18.063123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-728a0ce6-408e-4b95-8ee4-2a1e04498908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:18.081807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a0ce6-408e-4b95-8ee4-2a1e04498908 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:18.171860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:18.173241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.173588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.173875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] PATH_INFO: `/v3/projects/ef36e856509541a68edfb16842f8ef9e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.180811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef36e856509541a68edfb16842f8ef9e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:18.182824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:18.252972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef36e856509541a68edfb16842f8ef9e', 'request_id': 'req-7957f024-c4c4-44e4-af7d-a62606e362b9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:18.259427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef36e856509541a68edfb16842f8ef9e', 'request_id': 'req-7957f024-c4c4-44e4-af7d-a62606e362b9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:18.272277 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef36e856509541a68edfb16842f8ef9e', 'request_id': 'req-7957f024-c4c4-44e4-af7d-a62606e362b9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:18.288465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] The token cache is being invalidate because project ef36e856509541a68edfb16842f8ef9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:35:18.288771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:18.289498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-7957f024-c4c4-44e4-af7d-a62606e362b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:18.291364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1238/2444] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:35:18 2022] DELETE /identity/v3/projects/ef36e856509541a68edfb16842f8ef9e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:18.296179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ec3be-6699-4b78-b453-eb4778b9f2fd None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.296598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ec3be-6699-4b78-b453-eb4778b9f2fd None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.297116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ec3be-6699-4b78-b453-eb4778b9f2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.320333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-be3ec3be-6699-4b78-b453-eb4778b9f2fd None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:18.322868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-be3ec3be-6699-4b78-b453-eb4778b9f2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:18.401164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1207/2445] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:18.406235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab12f2-13b2-47c5-981f-c11ea259344b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.406529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab12f2-13b2-47c5-981f-c11ea259344b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.406805 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab12f2-13b2-47c5-981f-c11ea259344b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.426307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-02ab12f2-13b2-47c5-981f-c11ea259344b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:18.427533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-02ab12f2-13b2-47c5-981f-c11ea259344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:18.439598 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1239/2446] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:18.440864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ec3be-6699-4b78-b453-eb4778b9f2fd None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:18.451650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ec3be-6699-4b78-b453-eb4778b9f2fd None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:18.457548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865357d2-ec0d-4f31-8e2d-7263a5cf1d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:18.458315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865357d2-ec0d-4f31-8e2d-7263a5cf1d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.458598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865357d2-ec0d-4f31-8e2d-7263a5cf1d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.458877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865357d2-ec0d-4f31-8e2d-7263a5cf1d29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.459670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865357d2-ec0d-4f31-8e2d-7263a5cf1d29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:35:18.459961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865357d2-ec0d-4f31-8e2d-7263a5cf1d29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:18.461680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865357d2-ec0d-4f31-8e2d-7263a5cf1d29 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:18.479301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1208/2447] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:35:18.484064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab12f2-13b2-47c5-981f-c11ea259344b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:18.511914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab12f2-13b2-47c5-981f-c11ea259344b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:18.521258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b029e1-8a78-48b0-a225-9de2ea80e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:18.522133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b029e1-8a78-48b0-a225-9de2ea80e551 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.522413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b029e1-8a78-48b0-a225-9de2ea80e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.522682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b029e1-8a78-48b0-a225-9de2ea80e551 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.523395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b029e1-8a78-48b0-a225-9de2ea80e551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:18.527118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b029e1-8a78-48b0-a225-9de2ea80e551 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:18.563321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1240/2448] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:35:18 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:18.565944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865357d2-ec0d-4f31-8e2d-7263a5cf1d29 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:18.578458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865357d2-ec0d-4f31-8e2d-7263a5cf1d29 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:18.653900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff409ae-03b8-4735-9b9c-fd56a7f27809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:18.654947 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff409ae-03b8-4735-9b9c-fd56a7f27809 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.655407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff409ae-03b8-4735-9b9c-fd56a7f27809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.655895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff409ae-03b8-4735-9b9c-fd56a7f27809 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.656667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff409ae-03b8-4735-9b9c-fd56a7f27809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:18.658838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff409ae-03b8-4735-9b9c-fd56a7f27809 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:18.687487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1209/2449] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:35:18 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:18.688887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b029e1-8a78-48b0-a225-9de2ea80e551 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:18.703453 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b029e1-8a78-48b0-a225-9de2ea80e551 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:18.708269 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091d598-922d-4eb6-ab97-2bbfacc7ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:18.708985 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091d598-922d-4eb6-ab97-2bbfacc7ebca admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.709268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091d598-922d-4eb6-ab97-2bbfacc7ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.709538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1091d598-922d-4eb6-ab97-2bbfacc7ebca admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.710270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091d598-922d-4eb6-ab97-2bbfacc7ebca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:18.711885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1091d598-922d-4eb6-ab97-2bbfacc7ebca admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:18.724602 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1241/2450] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:18.728923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff409ae-03b8-4735-9b9c-fd56a7f27809 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:18.749454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff409ae-03b8-4735-9b9c-fd56a7f27809 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:18.758903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6e1a5-9876-47d7-9c6b-ef018d144582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:18.759800 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6e1a5-9876-47d7-9c6b-ef018d144582 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.760133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6e1a5-9876-47d7-9c6b-ef018d144582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.760490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6e1a5-9876-47d7-9c6b-ef018d144582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.761270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6e1a5-9876-47d7-9c6b-ef018d144582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:18.762987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6e1a5-9876-47d7-9c6b-ef018d144582 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:18.783874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1210/2451] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:18.785358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091d598-922d-4eb6-ab97-2bbfacc7ebca admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:18.796228 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1091d598-922d-4eb6-ab97-2bbfacc7ebca admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:18.801119 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9da6c-32da-4d21-928c-ef10a06c34d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:18.802089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9da6c-32da-4d21-928c-ef10a06c34d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.802529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9da6c-32da-4d21-928c-ef10a06c34d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.802859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9da6c-32da-4d21-928c-ef10a06c34d4 admin admin] PATH_INFO: `/v3/projects/9c0865a6da4741ffb00c5bad678cc2a4/users/963dbdb0bf294ab3a9b2a419c5e7ce63/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.824991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9da6c-32da-4d21-928c-ef10a06c34d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0865a6da4741ffb00c5bad678cc2a4, user_id=963dbdb0bf294ab3a9b2a419c5e7ce63, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:18.830696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9da6c-32da-4d21-928c-ef10a06c34d4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:18.849657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1242/2452] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:18 2022] PUT /identity/v3/projects/9c0865a6da4741ffb00c5bad678cc2a4/users/963dbdb0bf294ab3a9b2a419c5e7ce63/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:35:18.863177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626325d-a12e-49f4-a876-459ff77d64d3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:18.863500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626325d-a12e-49f4-a876-459ff77d64d3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:18.863974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626325d-a12e-49f4-a876-459ff77d64d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:18.893925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2626325d-a12e-49f4-a876-459ff77d64d3 None None] MFA Rules not processed for user `963dbdb0bf294ab3a9b2a419c5e7ce63`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:18.895394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2626325d-a12e-49f4-a876-459ff77d64d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:18.917420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:18.993072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9da6c-32da-4d21-928c-ef10a06c34d4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:18.994200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1211/2453] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:35:19.034622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:19.080147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9da6c-32da-4d21-928c-ef10a06c34d4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:19.087444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e82e57-3dc7-458c-8f37-626dba8b90f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:19.088131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e82e57-3dc7-458c-8f37-626dba8b90f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:19.088418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e82e57-3dc7-458c-8f37-626dba8b90f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:19.088695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e82e57-3dc7-458c-8f37-626dba8b90f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:19.089778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e82e57-3dc7-458c-8f37-626dba8b90f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:19.091774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e82e57-3dc7-458c-8f37-626dba8b90f4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:19.132832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1243/2454] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:35:18 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:19.133649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626325d-a12e-49f4-a876-459ff77d64d3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:19.146516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626325d-a12e-49f4-a876-459ff77d64d3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:19.209394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec960c74-696b-4b34-9798-94d1179d909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:19.210098 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec960c74-696b-4b34-9798-94d1179d909b admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:19.210383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec960c74-696b-4b34-9798-94d1179d909b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:19.210660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec960c74-696b-4b34-9798-94d1179d909b admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:19.211369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec960c74-696b-4b34-9798-94d1179d909b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:19.213372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec960c74-696b-4b34-9798-94d1179d909b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:19.241030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1212/2455] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:35:19 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:35:19.242224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e82e57-3dc7-458c-8f37-626dba8b90f4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:19.253960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e82e57-3dc7-458c-8f37-626dba8b90f4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:19.259202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b74bd9-96e7-40fe-a7df-403e59de6b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:19.259916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74bd9-96e7-40fe-a7df-403e59de6b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:19.260202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74bd9-96e7-40fe-a7df-403e59de6b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:19.260478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74bd9-96e7-40fe-a7df-403e59de6b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:19.261256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b74bd9-96e7-40fe-a7df-403e59de6b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:19.262891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b74bd9-96e7-40fe-a7df-403e59de6b96 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:19.282032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1244/2456] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:19.283242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec960c74-696b-4b34-9798-94d1179d909b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:19.294226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec960c74-696b-4b34-9798-94d1179d909b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:19.299845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb7c8a-ce48-4269-8b41-ab4cac0f5680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:19.301373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb7c8a-ce48-4269-8b41-ab4cac0f5680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:19.301675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb7c8a-ce48-4269-8b41-ab4cac0f5680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:19.301993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb7c8a-ce48-4269-8b41-ab4cac0f5680 admin admin] PATH_INFO: `/v3/projects/e6a437921267481aa9b40c379b7edc63/users/540ffd0ba36c458082a8cf5e2ccaafc9/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:19.320757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb7c8a-ce48-4269-8b41-ab4cac0f5680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a437921267481aa9b40c379b7edc63, user_id=540ffd0ba36c458082a8cf5e2ccaafc9, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:19.323582 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb7c8a-ce48-4269-8b41-ab4cac0f5680 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:19.341229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1213/2457] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:19 2022] PUT /identity/v3/projects/e6a437921267481aa9b40c379b7edc63/users/540ffd0ba36c458082a8cf5e2ccaafc9/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:35:19.345039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b74bd9-96e7-40fe-a7df-403e59de6b96 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:19.355637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b74bd9-96e7-40fe-a7df-403e59de6b96 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:19.423957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45f203-9952-40ff-889e-53faade6ef46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:19.424748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45f203-9952-40ff-889e-53faade6ef46 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:19.425129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45f203-9952-40ff-889e-53faade6ef46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:19.425418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45f203-9952-40ff-889e-53faade6ef46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:19.426147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45f203-9952-40ff-889e-53faade6ef46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:19.427764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45f203-9952-40ff-889e-53faade6ef46 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:19.441595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1245/2458] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:35:19.442870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb7c8a-ce48-4269-8b41-ab4cac0f5680 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:19.453644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb7c8a-ce48-4269-8b41-ab4cac0f5680 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:19.460308 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875f1d5-6be6-497a-b6f6-1d6376c8ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:19.461279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875f1d5-6be6-497a-b6f6-1d6376c8ae10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:19.461557 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875f1d5-6be6-497a-b6f6-1d6376c8ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:19.461844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875f1d5-6be6-497a-b6f6-1d6376c8ae10 admin admin] PATH_INFO: `/v3/projects/e6a437921267481aa9b40c379b7edc63/users/540ffd0ba36c458082a8cf5e2ccaafc9/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:19.463881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875f1d5-6be6-497a-b6f6-1d6376c8ae10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a437921267481aa9b40c379b7edc63, user_id=540ffd0ba36c458082a8cf5e2ccaafc9, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:19.466926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875f1d5-6be6-497a-b6f6-1d6376c8ae10 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:19.489246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1214/2459] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:19 2022] PUT /identity/v3/projects/e6a437921267481aa9b40c379b7edc63/users/540ffd0ba36c458082a8cf5e2ccaafc9/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:35:19.492651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227372b0-8c02-42db-8bae-32f89d6aebf2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:19.492977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227372b0-8c02-42db-8bae-32f89d6aebf2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:19.493257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227372b0-8c02-42db-8bae-32f89d6aebf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:19.524947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-227372b0-8c02-42db-8bae-32f89d6aebf2 None None] MFA Rules not processed for user `540ffd0ba36c458082a8cf5e2ccaafc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:19.526207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-227372b0-8c02-42db-8bae-32f89d6aebf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:19.610278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1246/2460] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:19.623167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875f1d5-6be6-497a-b6f6-1d6376c8ae10 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:19.625367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6875f1d5-6be6-497a-b6f6-1d6376c8ae10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:19.699254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875f1d5-6be6-497a-b6f6-1d6376c8ae10 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:19.703945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bcd8d-f261-48ec-b497-54f09517903c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:19.704641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bcd8d-f261-48ec-b497-54f09517903c service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:19.704971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bcd8d-f261-48ec-b497-54f09517903c service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:19.705250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bcd8d-f261-48ec-b497-54f09517903c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:19.721689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bcd8d-f261-48ec-b497-54f09517903c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:19.723690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bcd8d-f261-48ec-b497-54f09517903c service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:19.747496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1215/2461] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:19.839385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227372b0-8c02-42db-8bae-32f89d6aebf2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:19.855124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227372b0-8c02-42db-8bae-32f89d6aebf2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:19.858820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22518174-8463-4cdd-b651-2c06bca64cb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:19.859492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518174-8463-4cdd-b651-2c06bca64cb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:19.859774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518174-8463-4cdd-b651-2c06bca64cb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:19.860048 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22518174-8463-4cdd-b651-2c06bca64cb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:19.875705 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:19.940133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22518174-8463-4cdd-b651-2c06bca64cb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:19.941806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22518174-8463-4cdd-b651-2c06bca64cb3 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:19.953824 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1247/2462] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:19 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:22.821870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bcd8d-f261-48ec-b497-54f09517903c service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:22.837105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:22.904707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bcd8d-f261-48ec-b497-54f09517903c service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:22.909704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:22.910672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:22.910954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:22.911230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] PATH_INFO: `/v3/users/963dbdb0bf294ab3a9b2a419c5e7ce63` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:22.912601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=963dbdb0bf294ab3a9b2a419c5e7ce63)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:22.914637 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:22.974568 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '963dbdb0bf294ab3a9b2a419c5e7ce63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:22.976231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '963dbdb0bf294ab3a9b2a419c5e7ce63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:22.976967 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '963dbdb0bf294ab3a9b2a419c5e7ce63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:22.991223 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '963dbdb0bf294ab3a9b2a419c5e7ce63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:22.998593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '963dbdb0bf294ab3a9b2a419c5e7ce63'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.018910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1216/2463] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:35:22 2022] DELETE /identity/v3/users/963dbdb0bf294ab3a9b2a419c5e7ce63 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:35:23.023438 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc66ade-532e-44ce-b744-1bcafb0ac085 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:23.023915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc66ade-532e-44ce-b744-1bcafb0ac085 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:23.023996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc66ade-532e-44ce-b744-1bcafb0ac085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:23.042634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-afc66ade-532e-44ce-b744-1bcafb0ac085 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:23.043873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-afc66ade-532e-44ce-b744-1bcafb0ac085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:23.116468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1248/2464] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:23.126650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:23.128398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:23.193976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061712f-3ccb-4728-946e-a3be94627e03 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:23.197932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb076f3-24e9-4784-82a5-4fe0b9923639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:23.198580 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb076f3-24e9-4784-82a5-4fe0b9923639 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:23.199111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb076f3-24e9-4784-82a5-4fe0b9923639 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:23.199111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb076f3-24e9-4784-82a5-4fe0b9923639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:23.209102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb076f3-24e9-4784-82a5-4fe0b9923639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:23.210569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb076f3-24e9-4784-82a5-4fe0b9923639 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:23.221628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1217/2465] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:23.551601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc66ade-532e-44ce-b744-1bcafb0ac085 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:23.553787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-afc66ade-532e-44ce-b744-1bcafb0ac085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:23.567771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc66ade-532e-44ce-b744-1bcafb0ac085 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:23.573908 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:23.575089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:23.575549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:23.575950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] PATH_INFO: `/v3/projects/9c0865a6da4741ffb00c5bad678cc2a4` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:23.578022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0865a6da4741ffb00c5bad678cc2a4)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:23.581152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:23.639145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0865a6da4741ffb00c5bad678cc2a4', 'request_id': 'req-3dd01524-8904-4157-a009-2a0a2ff612c3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.645438 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0865a6da4741ffb00c5bad678cc2a4', 'request_id': 'req-3dd01524-8904-4157-a009-2a0a2ff612c3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.655991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0865a6da4741ffb00c5bad678cc2a4', 'request_id': 'req-3dd01524-8904-4157-a009-2a0a2ff612c3'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.682143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] The token cache is being invalidate because project 9c0865a6da4741ffb00c5bad678cc2a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:35:23.682630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.684285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.686365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1249/2466] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:35:23 2022] DELETE /identity/v3/projects/9c0865a6da4741ffb00c5bad678cc2a4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:23.690418 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb076f3-24e9-4784-82a5-4fe0b9923639 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:23.701259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb076f3-24e9-4784-82a5-4fe0b9923639 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:23.740511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:23.780116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:23.781054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:23.781335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:23.781609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] PATH_INFO: `/v3/users/540ffd0ba36c458082a8cf5e2ccaafc9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:23.783026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540ffd0ba36c458082a8cf5e2ccaafc9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:23.785214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:23.873372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540ffd0ba36c458082a8cf5e2ccaafc9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.874313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540ffd0ba36c458082a8cf5e2ccaafc9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.875022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540ffd0ba36c458082a8cf5e2ccaafc9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.902390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540ffd0ba36c458082a8cf5e2ccaafc9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.909816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-54710993-a5bf-4100-95ac-93036eae4899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540ffd0ba36c458082a8cf5e2ccaafc9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:23.932117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1218/2467] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:35:23 2022] DELETE /identity/v3/users/540ffd0ba36c458082a8cf5e2ccaafc9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:24.261341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:24.264305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:24.304794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd01524-8904-4157-a009-2a0a2ff612c3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:24.348519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:24.372406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:24.373267 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:24.373576 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:24.374071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] PATH_INFO: `/v3/projects/e6a437921267481aa9b40c379b7edc63` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:24.375257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a437921267481aa9b40c379b7edc63)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:24.377636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:24.432736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a437921267481aa9b40c379b7edc63', 'request_id': 'req-92047136-163c-4f76-a447-5d4e6160569c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:24.439780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a437921267481aa9b40c379b7edc63', 'request_id': 'req-92047136-163c-4f76-a447-5d4e6160569c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:24.450735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a437921267481aa9b40c379b7edc63', 'request_id': 'req-92047136-163c-4f76-a447-5d4e6160569c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:24.463452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] The token cache is being invalidate because project e6a437921267481aa9b40c379b7edc63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:35:24.464131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:24.464869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-92047136-163c-4f76-a447-5d4e6160569c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:24.466711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1250/2468] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:35:24 2022] DELETE /identity/v3/projects/e6a437921267481aa9b40c379b7edc63 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:35:24.472722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c2c0-3c16-4d6f-a40e-3810e7207805 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:24.473186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c2c0-3c16-4d6f-a40e-3810e7207805 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:24.473409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c2c0-3c16-4d6f-a40e-3810e7207805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:24.494763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-5338c2c0-3c16-4d6f-a40e-3810e7207805 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:24.495834 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-5338c2c0-3c16-4d6f-a40e-3810e7207805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:24.567643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1219/2469] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:24.577075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93fa55-491a-4c85-a328-4b0a2e231e07 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:24.577360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93fa55-491a-4c85-a328-4b0a2e231e07 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:24.577632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93fa55-491a-4c85-a328-4b0a2e231e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:24.597240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ab93fa55-491a-4c85-a328-4b0a2e231e07 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:24.598718 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ab93fa55-491a-4c85-a328-4b0a2e231e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:24.607887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1251/2470] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:35:24.617238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c2c0-3c16-4d6f-a40e-3810e7207805 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:24.629767 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c2c0-3c16-4d6f-a40e-3810e7207805 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:24.634652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94aab75-150c-4c8c-a0cf-50fff8668c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:24.635323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94aab75-150c-4c8c-a0cf-50fff8668c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:24.635606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94aab75-150c-4c8c-a0cf-50fff8668c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:24.635878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94aab75-150c-4c8c-a0cf-50fff8668c12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:24.636615 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94aab75-150c-4c8c-a0cf-50fff8668c12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:35:24.636953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94aab75-150c-4c8c-a0cf-50fff8668c12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:24.638578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94aab75-150c-4c8c-a0cf-50fff8668c12 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:24.656771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1220/2471] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:35:24.657857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93fa55-491a-4c85-a328-4b0a2e231e07 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:24.668698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93fa55-491a-4c85-a328-4b0a2e231e07 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:24.674401 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee33655-35de-4a8b-ad76-1b96074669a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:24.675088 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee33655-35de-4a8b-ad76-1b96074669a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:24.675369 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee33655-35de-4a8b-ad76-1b96074669a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:24.675645 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee33655-35de-4a8b-ad76-1b96074669a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:24.676471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee33655-35de-4a8b-ad76-1b96074669a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:24.678465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee33655-35de-4a8b-ad76-1b96074669a8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:24.712762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1252/2472] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:35:24 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:35:24.717140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94aab75-150c-4c8c-a0cf-50fff8668c12 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:24.730433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94aab75-150c-4c8c-a0cf-50fff8668c12 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:24.784795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:24.808191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6095-68e1-4d70-8d7a-2cc92f70bebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:24.808984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6095-68e1-4d70-8d7a-2cc92f70bebb admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:24.809270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6095-68e1-4d70-8d7a-2cc92f70bebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:24.809545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a6095-68e1-4d70-8d7a-2cc92f70bebb admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:24.810257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a6095-68e1-4d70-8d7a-2cc92f70bebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:24.812203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a6095-68e1-4d70-8d7a-2cc92f70bebb admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:24.838262 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1221/2473] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:35:24 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:35:24.842538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee33655-35de-4a8b-ad76-1b96074669a8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:24.854913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee33655-35de-4a8b-ad76-1b96074669a8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:24.859630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c811d80-1b38-47f5-8361-d4fe300f69a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:24.860312 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c811d80-1b38-47f5-8361-d4fe300f69a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:24.860595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c811d80-1b38-47f5-8361-d4fe300f69a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:24.860970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c811d80-1b38-47f5-8361-d4fe300f69a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:24.861691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c811d80-1b38-47f5-8361-d4fe300f69a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:24.863308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c811d80-1b38-47f5-8361-d4fe300f69a9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:24.875353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1253/2474] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:24.879308 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6095-68e1-4d70-8d7a-2cc92f70bebb admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:24.889837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a6095-68e1-4d70-8d7a-2cc92f70bebb admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:24.897674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd144f6-2de5-4fbe-917d-75cf41d8c6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:24.898990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd144f6-2de5-4fbe-917d-75cf41d8c6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:24.899633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd144f6-2de5-4fbe-917d-75cf41d8c6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:24.900295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd144f6-2de5-4fbe-917d-75cf41d8c6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:24.901517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd144f6-2de5-4fbe-917d-75cf41d8c6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:24.903699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd144f6-2de5-4fbe-917d-75cf41d8c6ca admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:24.919228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1222/2475] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:24.924124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c811d80-1b38-47f5-8361-d4fe300f69a9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:24.939402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c811d80-1b38-47f5-8361-d4fe300f69a9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:24.953467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ed9ed-5939-40c2-badb-f6c45028593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:24.954511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ed9ed-5939-40c2-badb-f6c45028593a admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:24.954906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ed9ed-5939-40c2-badb-f6c45028593a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:24.955324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ed9ed-5939-40c2-badb-f6c45028593a admin admin] PATH_INFO: `/v3/projects/fa92adb136444881bfe562b8d7e435fb/users/8751460f87794f70a7481390049cdf78/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:24.980033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ed9ed-5939-40c2-badb-f6c45028593a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa92adb136444881bfe562b8d7e435fb, user_id=8751460f87794f70a7481390049cdf78, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:24.982804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ed9ed-5939-40c2-badb-f6c45028593a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:25.002089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1254/2476] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:24 2022] PUT /identity/v3/projects/fa92adb136444881bfe562b8d7e435fb/users/8751460f87794f70a7481390049cdf78/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:25.012183 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984be637-b2d0-4158-a12e-415f2bf1d0f0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.013139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984be637-b2d0-4158-a12e-415f2bf1d0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.013512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984be637-b2d0-4158-a12e-415f2bf1d0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:25.062760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-984be637-b2d0-4158-a12e-415f2bf1d0f0 None None] MFA Rules not processed for user `8751460f87794f70a7481390049cdf78`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:25.064219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-984be637-b2d0-4158-a12e-415f2bf1d0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:25.156294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1223/2477] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:25.162636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ed9ed-5939-40c2-badb-f6c45028593a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:25.234654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ed9ed-5939-40c2-badb-f6c45028593a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:25.239790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c32aa-8bb9-4aa6-83dd-2b5fb284797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:25.240501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c32aa-8bb9-4aa6-83dd-2b5fb284797f admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.240833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c32aa-8bb9-4aa6-83dd-2b5fb284797f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.241239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c32aa-8bb9-4aa6-83dd-2b5fb284797f admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:25.241992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c32aa-8bb9-4aa6-83dd-2b5fb284797f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:25.244389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c32aa-8bb9-4aa6-83dd-2b5fb284797f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:25.255189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:25.282919 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1255/2478] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:35:25 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:25.284335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984be637-b2d0-4158-a12e-415f2bf1d0f0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:25.296352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984be637-b2d0-4158-a12e-415f2bf1d0f0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:25.362452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8f27-f8f5-41e1-99e1-6c0cce730300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:25.363166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8f27-f8f5-41e1-99e1-6c0cce730300 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.363446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8f27-f8f5-41e1-99e1-6c0cce730300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.363721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8f27-f8f5-41e1-99e1-6c0cce730300 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:25.364414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e8f27-f8f5-41e1-99e1-6c0cce730300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:25.366499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44e8f27-f8f5-41e1-99e1-6c0cce730300 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:25.396943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1224/2479] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:35:25 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:25.400972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c32aa-8bb9-4aa6-83dd-2b5fb284797f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:25.412377 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c32aa-8bb9-4aa6-83dd-2b5fb284797f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:25.420982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438afb-fd2f-4642-a0ae-dd1201c54b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:25.421994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438afb-fd2f-4642-a0ae-dd1201c54b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.422519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438afb-fd2f-4642-a0ae-dd1201c54b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.422992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438afb-fd2f-4642-a0ae-dd1201c54b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:25.424577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438afb-fd2f-4642-a0ae-dd1201c54b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:25.426738 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438afb-fd2f-4642-a0ae-dd1201c54b6a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:25.442000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1256/2480] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:25.443515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8f27-f8f5-41e1-99e1-6c0cce730300 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:25.455786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8f27-f8f5-41e1-99e1-6c0cce730300 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:25.460905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6ca97-1d85-4949-8540-dea1b98157ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:25.461820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6ca97-1d85-4949-8540-dea1b98157ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.462331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6ca97-1d85-4949-8540-dea1b98157ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.462610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6ca97-1d85-4949-8540-dea1b98157ab admin admin] PATH_INFO: `/v3/projects/af56ae8963e54b33814d8d94db99f85c/users/f3ef28563a9045ac9e84485eb8f7829f/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:25.481805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6ca97-1d85-4949-8540-dea1b98157ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=af56ae8963e54b33814d8d94db99f85c, user_id=f3ef28563a9045ac9e84485eb8f7829f, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:25.484503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6ca97-1d85-4949-8540-dea1b98157ab admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:25.502512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1225/2481] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:25 2022] PUT /identity/v3/projects/af56ae8963e54b33814d8d94db99f85c/users/f3ef28563a9045ac9e84485eb8f7829f/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:25.506785 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438afb-fd2f-4642-a0ae-dd1201c54b6a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:25.519135 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438afb-fd2f-4642-a0ae-dd1201c54b6a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:25.586699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5094c0-e467-456c-ac7e-fabf2a3560e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:25.587589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5094c0-e467-456c-ac7e-fabf2a3560e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.588467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5094c0-e467-456c-ac7e-fabf2a3560e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.589101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5094c0-e467-456c-ac7e-fabf2a3560e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:25.589899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5094c0-e467-456c-ac7e-fabf2a3560e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:25.591522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5094c0-e467-456c-ac7e-fabf2a3560e1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:25.603667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1257/2482] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:25.607895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6ca97-1d85-4949-8540-dea1b98157ab admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:25.623524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6ca97-1d85-4949-8540-dea1b98157ab admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:25.629933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9dbe-7cc6-4542-91df-ed9503e1f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:25.630883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9dbe-7cc6-4542-91df-ed9503e1f0f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.631183 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9dbe-7cc6-4542-91df-ed9503e1f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.631462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a9dbe-7cc6-4542-91df-ed9503e1f0f7 admin admin] PATH_INFO: `/v3/projects/af56ae8963e54b33814d8d94db99f85c/users/f3ef28563a9045ac9e84485eb8f7829f/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:25.633837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a9dbe-7cc6-4542-91df-ed9503e1f0f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af56ae8963e54b33814d8d94db99f85c, user_id=f3ef28563a9045ac9e84485eb8f7829f, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:25.636669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a9dbe-7cc6-4542-91df-ed9503e1f0f7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:25.652211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1226/2483] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:25 2022] PUT /identity/v3/projects/af56ae8963e54b33814d8d94db99f85c/users/f3ef28563a9045ac9e84485eb8f7829f/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:25.664205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a06bbd-336b-4fd0-8711-ea269abfec00 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.664493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a06bbd-336b-4fd0-8711-ea269abfec00 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.664834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a06bbd-336b-4fd0-8711-ea269abfec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:25.695528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e8a06bbd-336b-4fd0-8711-ea269abfec00 None None] MFA Rules not processed for user `f3ef28563a9045ac9e84485eb8f7829f`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:25.697167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e8a06bbd-336b-4fd0-8711-ea269abfec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:25.779628 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1258/2484] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:25.791355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9dbe-7cc6-4542-91df-ed9503e1f0f7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:25.793108 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c11a9dbe-7cc6-4542-91df-ed9503e1f0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:25.798798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:25.862433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a9dbe-7cc6-4542-91df-ed9503e1f0f7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:25.866191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3da5cb-cd8b-43f8-942a-10ad4bbd8e4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:25.867351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3da5cb-cd8b-43f8-942a-10ad4bbd8e4b service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.867711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3da5cb-cd8b-43f8-942a-10ad4bbd8e4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.867992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3da5cb-cd8b-43f8-942a-10ad4bbd8e4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:25.880877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3da5cb-cd8b-43f8-942a-10ad4bbd8e4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:25.882374 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3da5cb-cd8b-43f8-942a-10ad4bbd8e4b service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:25.892286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1227/2485] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:25.939311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a06bbd-336b-4fd0-8711-ea269abfec00 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:25.940999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e8a06bbd-336b-4fd0-8711-ea269abfec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:25.955973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a06bbd-336b-4fd0-8711-ea269abfec00 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:25.960058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaf264-9045-4013-8bec-e6ef284c7b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:25.960795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaf264-9045-4013-8bec-e6ef284c7b38 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:25.961215 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaf264-9045-4013-8bec-e6ef284c7b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:25.961471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaf264-9045-4013-8bec-e6ef284c7b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:26.028577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaf264-9045-4013-8bec-e6ef284c7b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:26.030112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaf264-9045-4013-8bec-e6ef284c7b38 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:26.036366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:26.044945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1259/2486] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:27.445317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3da5cb-cd8b-43f8-942a-10ad4bbd8e4b service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:27.445838 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1f3da5cb-cd8b-43f8-942a-10ad4bbd8e4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:27.507698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3da5cb-cd8b-43f8-942a-10ad4bbd8e4b service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:27.511475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aebe8-42a7-4bf4-9d4b-a972a17c4a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:27.512160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aebe8-42a7-4bf4-9d4b-a972a17c4a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:27.512362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aebe8-42a7-4bf4-9d4b-a972a17c4a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:27.512633 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76aebe8-42a7-4bf4-9d4b-a972a17c4a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:27.514438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a76aebe8-42a7-4bf4-9d4b-a972a17c4a3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:27.617493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aebe8-42a7-4bf4-9d4b-a972a17c4a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:27.619159 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76aebe8-42a7-4bf4-9d4b-a972a17c4a3c service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:27.642547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1228/2487] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:28.945111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaf264-9045-4013-8bec-e6ef284c7b38 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:28.947567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3bfaf264-9045-4013-8bec-e6ef284c7b38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:28.962575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaf264-9045-4013-8bec-e6ef284c7b38 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:28.967793 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123693c-9fce-4c92-9a16-b77dbc7ba58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:28.968484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123693c-9fce-4c92-9a16-b77dbc7ba58e service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:28.968759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123693c-9fce-4c92-9a16-b77dbc7ba58e service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:28.969059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123693c-9fce-4c92-9a16-b77dbc7ba58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:28.971103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-b123693c-9fce-4c92-9a16-b77dbc7ba58e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:28.986323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123693c-9fce-4c92-9a16-b77dbc7ba58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:28.987776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123693c-9fce-4c92-9a16-b77dbc7ba58e service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:28.999776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1260/2488] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:29.506806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aebe8-42a7-4bf4-9d4b-a972a17c4a3c service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:29.538276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:29.580163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76aebe8-42a7-4bf4-9d4b-a972a17c4a3c service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:29.585002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:29.585880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:29.586158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:29.586426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] PATH_INFO: `/v3/users/8751460f87794f70a7481390049cdf78` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:29.587629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8751460f87794f70a7481390049cdf78)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:29.589970 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:29.641052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8751460f87794f70a7481390049cdf78'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:29.641709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8751460f87794f70a7481390049cdf78'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:29.642307 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8751460f87794f70a7481390049cdf78'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:29.654163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8751460f87794f70a7481390049cdf78'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:29.661294 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8751460f87794f70a7481390049cdf78'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:29.676696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1229/2489] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:35:29 2022] DELETE /identity/v3/users/8751460f87794f70a7481390049cdf78 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:29.681303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266eca7-3bec-4da9-989a-37b7fb05c993 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:29.681579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266eca7-3bec-4da9-989a-37b7fb05c993 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:29.681858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266eca7-3bec-4da9-989a-37b7fb05c993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:29.698916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0266eca7-3bec-4da9-989a-37b7fb05c993 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:29.700153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0266eca7-3bec-4da9-989a-37b7fb05c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:29.762537 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1261/2490] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:29.772669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:29.774184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:29.835903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f67230-0ff9-4c87-a635-3ed3dd27fad6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:29.840980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2bb6f-6638-4e66-bdd8-51d13724ba89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:29.841658 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2bb6f-6638-4e66-bdd8-51d13724ba89 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:29.841915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2bb6f-6638-4e66-bdd8-51d13724ba89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:29.842212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2bb6f-6638-4e66-bdd8-51d13724ba89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:29.852095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2bb6f-6638-4e66-bdd8-51d13724ba89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:29.853602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c2bb6f-6638-4e66-bdd8-51d13724ba89 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:29.864354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1230/2491] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:30.140648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266eca7-3bec-4da9-989a-37b7fb05c993 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:30.142212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0266eca7-3bec-4da9-989a-37b7fb05c993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:30.154767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266eca7-3bec-4da9-989a-37b7fb05c993 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:30.165764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:30.166654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:30.169151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:30.169440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] PATH_INFO: `/v3/projects/fa92adb136444881bfe562b8d7e435fb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:30.171049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa92adb136444881bfe562b8d7e435fb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:30.173062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:30.224086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa92adb136444881bfe562b8d7e435fb', 'request_id': 'req-df274aad-3ec6-4a47-9e36-945aa79e12b2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.231154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa92adb136444881bfe562b8d7e435fb', 'request_id': 'req-df274aad-3ec6-4a47-9e36-945aa79e12b2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.239865 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa92adb136444881bfe562b8d7e435fb', 'request_id': 'req-df274aad-3ec6-4a47-9e36-945aa79e12b2'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.254772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] The token cache is being invalidate because project fa92adb136444881bfe562b8d7e435fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:35:30.255058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.255701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.257301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1262/2492] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:35:30 2022] DELETE /identity/v3/projects/fa92adb136444881bfe562b8d7e435fb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:30.261377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2bb6f-6638-4e66-bdd8-51d13724ba89 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:30.271723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2bb6f-6638-4e66-bdd8-51d13724ba89 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:30.317895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:30.332898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:30.333993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:30.334100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:30.334310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] PATH_INFO: `/v3/users/f3ef28563a9045ac9e84485eb8f7829f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:30.335542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ef28563a9045ac9e84485eb8f7829f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:30.337592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:30.389602 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ef28563a9045ac9e84485eb8f7829f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.390219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ef28563a9045ac9e84485eb8f7829f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.390857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ef28563a9045ac9e84485eb8f7829f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.404882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ef28563a9045ac9e84485eb8f7829f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.412188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-1efd00c5-62bf-43ba-97bd-50e22619af7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ef28563a9045ac9e84485eb8f7829f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.428942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1231/2493] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:35:30 2022] DELETE /identity/v3/users/f3ef28563a9045ac9e84485eb8f7829f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:30.731557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:30.733245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:30.759349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274aad-3ec6-4a47-9e36-945aa79e12b2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:30.824197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:30.825095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:30.825378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:30.825652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] PATH_INFO: `/v3/projects/af56ae8963e54b33814d8d94db99f85c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:30.826853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af56ae8963e54b33814d8d94db99f85c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:30.828762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:30.841113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:30.881920 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af56ae8963e54b33814d8d94db99f85c', 'request_id': 'req-09e91c82-10cc-4318-a5f3-b48a3e95930c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.887768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af56ae8963e54b33814d8d94db99f85c', 'request_id': 'req-09e91c82-10cc-4318-a5f3-b48a3e95930c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.896816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af56ae8963e54b33814d8d94db99f85c', 'request_id': 'req-09e91c82-10cc-4318-a5f3-b48a3e95930c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.908479 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] The token cache is being invalidate because project af56ae8963e54b33814d8d94db99f85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:35:30.908684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.909400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-09e91c82-10cc-4318-a5f3-b48a3e95930c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:30.914433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1263/2494] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:35:30 2022] DELETE /identity/v3/projects/af56ae8963e54b33814d8d94db99f85c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:30.916743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cb59d-0b3a-4e87-8906-f3980cac7ab9 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:30.917270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cb59d-0b3a-4e87-8906-f3980cac7ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:30.917480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cb59d-0b3a-4e87-8906-f3980cac7ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:30.935914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8c1cb59d-0b3a-4e87-8906-f3980cac7ab9 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:30.937157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8c1cb59d-0b3a-4e87-8906-f3980cac7ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:31.004773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1232/2495] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:31.014023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c3a3-3cde-44b2-863c-bc1e24972d5e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.014432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c3a3-3cde-44b2-863c-bc1e24972d5e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.014711 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350c3a3-3cde-44b2-863c-bc1e24972d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.034446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8350c3a3-3cde-44b2-863c-bc1e24972d5e None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:31.035637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8350c3a3-3cde-44b2-863c-bc1e24972d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:31.045023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1264/2496] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:31.048556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cb59d-0b3a-4e87-8906-f3980cac7ab9 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.058798 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cb59d-0b3a-4e87-8906-f3980cac7ab9 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.063690 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5453caf-328a-4c88-ad5f-089d4852d27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.064352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5453caf-328a-4c88-ad5f-089d4852d27b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.064634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5453caf-328a-4c88-ad5f-089d4852d27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.064903 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5453caf-328a-4c88-ad5f-089d4852d27b admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.065721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5453caf-328a-4c88-ad5f-089d4852d27b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:35:31.066023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5453caf-328a-4c88-ad5f-089d4852d27b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.067634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5453caf-328a-4c88-ad5f-089d4852d27b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.083518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1233/2497] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:35:31.084759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c3a3-3cde-44b2-863c-bc1e24972d5e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.094865 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350c3a3-3cde-44b2-863c-bc1e24972d5e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.101998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedca2e5-0533-4def-a8bd-4ef2cb59b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.102662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedca2e5-0533-4def-a8bd-4ef2cb59b4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.102942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedca2e5-0533-4def-a8bd-4ef2cb59b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.103211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedca2e5-0533-4def-a8bd-4ef2cb59b4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.103901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedca2e5-0533-4def-a8bd-4ef2cb59b4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.105903 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedca2e5-0533-4def-a8bd-4ef2cb59b4f4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.136914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1265/2498] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:31.138499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5453caf-328a-4c88-ad5f-089d4852d27b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.148910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5453caf-328a-4c88-ad5f-089d4852d27b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.202471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:31.214711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de111d7-1e6b-40d5-9c67-8303b0783f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.215614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de111d7-1e6b-40d5-9c67-8303b0783f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.215901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de111d7-1e6b-40d5-9c67-8303b0783f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.217512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de111d7-1e6b-40d5-9c67-8303b0783f61 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.218575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de111d7-1e6b-40d5-9c67-8303b0783f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.220586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de111d7-1e6b-40d5-9c67-8303b0783f61 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.236999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc634545-9af9-423f-836b-c7300bbf3b2e None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.237599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc634545-9af9-423f-836b-c7300bbf3b2e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.237599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc634545-9af9-423f-836b-c7300bbf3b2e None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.239082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1266/2499] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 01 16:35:31.244271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1234/2500] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:31.247000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aafed-3d3e-408a-a019-102e7442219a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.247362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aafed-3d3e-408a-a019-102e7442219a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.247720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21aafed-3d3e-408a-a019-102e7442219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.249846 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de111d7-1e6b-40d5-9c67-8303b0783f61 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.260117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de111d7-1e6b-40d5-9c67-8303b0783f61 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.264885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20846b8f-dd2b-4dca-9583-79b765fdaec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.265571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20846b8f-dd2b-4dca-9583-79b765fdaec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.265854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20846b8f-dd2b-4dca-9583-79b765fdaec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.266132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20846b8f-dd2b-4dca-9583-79b765fdaec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.267228 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20846b8f-dd2b-4dca-9583-79b765fdaec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.268554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20846b8f-dd2b-4dca-9583-79b765fdaec1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.280701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1235/2501] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:31.284921 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20846b8f-dd2b-4dca-9583-79b765fdaec1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.288643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-a21aafed-3d3e-408a-a019-102e7442219a None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:31.290481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a21aafed-3d3e-408a-a019-102e7442219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:31.295825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20846b8f-dd2b-4dca-9583-79b765fdaec1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.301381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf525-c7f1-4979-81b5-cd66f6a64e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.302069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf525-c7f1-4979-81b5-cd66f6a64e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.302354 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf525-c7f1-4979-81b5-cd66f6a64e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.302635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbf525-c7f1-4979-81b5-cd66f6a64e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.303372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf525-c7f1-4979-81b5-cd66f6a64e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.305113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbf525-c7f1-4979-81b5-cd66f6a64e15 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.316604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1236/2502] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:31.320532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf525-c7f1-4979-81b5-cd66f6a64e15 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.330407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbf525-c7f1-4979-81b5-cd66f6a64e15 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.335247 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7128-90cb-467e-bb06-354753a9c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.336138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7128-90cb-467e-bb06-354753a9c5ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.336421 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7128-90cb-467e-bb06-354753a9c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.336698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7128-90cb-467e-bb06-354753a9c5ee admin admin] PATH_INFO: `/v3/projects/94b03ff677774589b356a1783c40ae5b/users/0a6db1fac4da417188b6e9294d929e0f/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.353026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f7128-90cb-467e-bb06-354753a9c5ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b03ff677774589b356a1783c40ae5b, user_id=0a6db1fac4da417188b6e9294d929e0f, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.356034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f7128-90cb-467e-bb06-354753a9c5ee admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.368649 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1267/2503] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:31.371865 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1237/2504] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:31 2022] PUT /identity/v3/projects/94b03ff677774589b356a1783c40ae5b/users/0a6db1fac4da417188b6e9294d929e0f/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:35:31.381560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21aafed-3d3e-408a-a019-102e7442219a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.383261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eded5d9-0e9c-4c1c-be9c-0dbf70cec343 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.383546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eded5d9-0e9c-4c1c-be9c-0dbf70cec343 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.383896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eded5d9-0e9c-4c1c-be9c-0dbf70cec343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.388216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a21aafed-3d3e-408a-a019-102e7442219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:31.412019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2eded5d9-0e9c-4c1c-be9c-0dbf70cec343 None None] MFA Rules not processed for user `0a6db1fac4da417188b6e9294d929e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:31.413362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2eded5d9-0e9c-4c1c-be9c-0dbf70cec343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:31.445213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:31.470071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21aafed-3d3e-408a-a019-102e7442219a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.484186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1238/2505] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:31.488443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eded5d9-0e9c-4c1c-be9c-0dbf70cec343 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.521074 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246c0bc-2c35-439f-9482-50a983fedd20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a4ed0881004eef94166ace450b8a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.521763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c0bc-2c35-439f-9482-50a983fedd20 service glance] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.522049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c0bc-2c35-439f-9482-50a983fedd20 service glance] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.522329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246c0bc-2c35-439f-9482-50a983fedd20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.550561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eded5d9-0e9c-4c1c-be9c-0dbf70cec343 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.555190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765f86-e180-4fc9-95ac-d8e678269c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.556584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765f86-e180-4fc9-95ac-d8e678269c91 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.556584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765f86-e180-4fc9-95ac-d8e678269c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.556584 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7765f86-e180-4fc9-95ac-d8e678269c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.557106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765f86-e180-4fc9-95ac-d8e678269c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.559048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7765f86-e180-4fc9-95ac-d8e678269c91 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.589068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1239/2506] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:35:31.590024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765f86-e180-4fc9-95ac-d8e678269c91 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.591845 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c0bc-2c35-439f-9482-50a983fedd20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.593359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246c0bc-2c35-439f-9482-50a983fedd20 service glance] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.603301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:31.604253 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1268/2507] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:31.655648 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7765f86-e180-4fc9-95ac-d8e678269c91 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.660543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff8e10-242e-4646-af2e-a4b05a3ba9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.661263 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff8e10-242e-4646-af2e-a4b05a3ba9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.661550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff8e10-242e-4646-af2e-a4b05a3ba9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.661826 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff8e10-242e-4646-af2e-a4b05a3ba9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.662576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff8e10-242e-4646-af2e-a4b05a3ba9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.664513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff8e10-242e-4646-af2e-a4b05a3ba9e6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.674361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ff89-3fbd-4d4e-838e-d07f39942f2c None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.674685 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ff89-3fbd-4d4e-838e-d07f39942f2c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.675033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0ff89-3fbd-4d4e-838e-d07f39942f2c None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.677289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1269/2508] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:35:31.682288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf794c-09ba-4f36-9b0b-f0dc2ebbd051 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.682577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf794c-09ba-4f36-9b0b-f0dc2ebbd051 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.682861 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf794c-09ba-4f36-9b0b-f0dc2ebbd051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.684871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1240/2509] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:35:31.688730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff8e10-242e-4646-af2e-a4b05a3ba9e6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.700565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff8e10-242e-4646-af2e-a4b05a3ba9e6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.702520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fcdf794c-09ba-4f36-9b0b-f0dc2ebbd051 None None] MFA Rules not processed for user `11785acde2f74ad481d1224f2a7fd296`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:31.703731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fcdf794c-09ba-4f36-9b0b-f0dc2ebbd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:31.705738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b4d3a-1839-4970-a19e-04583fe2e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.706567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b4d3a-1839-4970-a19e-04583fe2e13c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.706851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b4d3a-1839-4970-a19e-04583fe2e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.707125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b4d3a-1839-4970-a19e-04583fe2e13c admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.707848 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b4d3a-1839-4970-a19e-04583fe2e13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.709540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b4d3a-1839-4970-a19e-04583fe2e13c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.723100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1241/2510] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:31.733367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b4d3a-1839-4970-a19e-04583fe2e13c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.754284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b4d3a-1839-4970-a19e-04583fe2e13c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.759687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72c67-6999-4f64-8c90-dfcc18d539ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.760566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72c67-6999-4f64-8c90-dfcc18d539ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.760856 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72c67-6999-4f64-8c90-dfcc18d539ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.761144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72c67-6999-4f64-8c90-dfcc18d539ae admin admin] PATH_INFO: `/v3/projects/433e583be3724fd5b82f0029ca3f4637/users/30f894cf159c4351bc6b822448782bbb/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.771912 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1270/2511] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:35:31.776877 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72c67-6999-4f64-8c90-dfcc18d539ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=433e583be3724fd5b82f0029ca3f4637, user_id=30f894cf159c4351bc6b822448782bbb, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.779642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72c67-6999-4f64-8c90-dfcc18d539ae admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.787568 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf794c-09ba-4f36-9b0b-f0dc2ebbd051 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.789978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fcdf794c-09ba-4f36-9b0b-f0dc2ebbd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:31.794864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1242/2512] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:31 2022] PUT /identity/v3/projects/433e583be3724fd5b82f0029ca3f4637/users/30f894cf159c4351bc6b822448782bbb/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:31.798741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72c67-6999-4f64-8c90-dfcc18d539ae admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.802565 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdf794c-09ba-4f36-9b0b-f0dc2ebbd051 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.843280 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:31.861811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49570-8c91-4ba7-ae44-3c524de2964a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.862509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49570-8c91-4ba7-ae44-3c524de2964a service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.862790 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49570-8c91-4ba7-ae44-3c524de2964a service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.863065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49570-8c91-4ba7-ae44-3c524de2964a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.868190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72c67-6999-4f64-8c90-dfcc18d539ae admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.870748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c49570-8c91-4ba7-ae44-3c524de2964a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.872509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c49570-8c91-4ba7-ae44-3c524de2964a service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.873572 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c833a1a-d638-461c-87dc-e7eb160d11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.874438 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c833a1a-d638-461c-87dc-e7eb160d11dc admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.874872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c833a1a-d638-461c-87dc-e7eb160d11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.875317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c833a1a-d638-461c-87dc-e7eb160d11dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.876204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c833a1a-d638-461c-87dc-e7eb160d11dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.877929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c833a1a-d638-461c-87dc-e7eb160d11dc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.882170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1271/2513] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:31.892142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1243/2514] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:35:31.893884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49570-8c91-4ba7-ae44-3c524de2964a service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:31.907506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49570-8c91-4ba7-ae44-3c524de2964a service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:31.912934 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426074a6-0657-4316-99bb-a5581fdbb86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:31.914102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426074a6-0657-4316-99bb-a5581fdbb86f admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.914434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426074a6-0657-4316-99bb-a5581fdbb86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.914713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426074a6-0657-4316-99bb-a5581fdbb86f admin admin] PATH_INFO: `/v3/projects/433e583be3724fd5b82f0029ca3f4637/users/30f894cf159c4351bc6b822448782bbb/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.917160 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426074a6-0657-4316-99bb-a5581fdbb86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=433e583be3724fd5b82f0029ca3f4637, user_id=30f894cf159c4351bc6b822448782bbb, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:31.919890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426074a6-0657-4316-99bb-a5581fdbb86f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:31.931550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1272/2515] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:31 2022] PUT /identity/v3/projects/433e583be3724fd5b82f0029ca3f4637/users/30f894cf159c4351bc6b822448782bbb/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:31.943519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948633-96d7-40d6-b323-6b3722e4c7ac None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.943980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948633-96d7-40d6-b323-6b3722e4c7ac None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.944370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80948633-96d7-40d6-b323-6b3722e4c7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.973570 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-80948633-96d7-40d6-b323-6b3722e4c7ac None None] MFA Rules not processed for user `30f894cf159c4351bc6b822448782bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:31.974930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-80948633-96d7-40d6-b323-6b3722e4c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:31.980364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184157-1311-4810-9fc9-0f437de26e67 None None] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.980653 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184157-1311-4810-9fc9-0f437de26e67 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.980983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184157-1311-4810-9fc9-0f437de26e67 None None] PATH_INFO: `/` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:31.982378 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1273/2516] 10.222.0.59 () {54 vars in 921 bytes} [Fri Jul 1 16:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 01 16:35:31.987605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe2c5-fc6e-414c-9255-80a1d3d33836 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:31.987913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe2c5-fc6e-414c-9255-80a1d3d33836 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:31.988192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfe2c5-fc6e-414c-9255-80a1d3d33836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:32.007398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-79cfe2c5-fc6e-414c-9255-80a1d3d33836 None None] MFA Rules not processed for user `efdfb91ba4c04452ba547baa184185c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:32.008756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-79cfe2c5-fc6e-414c-9255-80a1d3d33836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:32.026751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:32.047861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1244/2517] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:32.059694 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80948633-96d7-40d6-b323-6b3722e4c7ac None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:32.061263 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-80948633-96d7-40d6-b323-6b3722e4c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:32.087982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1274/2518] 10.222.0.59 () {58 vars in 1018 bytes} [Fri Jul 1 16:35:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:35:32.099076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe2c5-fc6e-414c-9255-80a1d3d33836 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:32.123502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80948633-96d7-40d6-b323-6b3722e4c7ac None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:32.127229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada41d9b-d2de-4e95-a909-5f51acf55004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:32.127917 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada41d9b-d2de-4e95-a909-5f51acf55004 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:32.128200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada41d9b-d2de-4e95-a909-5f51acf55004 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:32.128475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada41d9b-d2de-4e95-a909-5f51acf55004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:32.137861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada41d9b-d2de-4e95-a909-5f51acf55004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:32.139314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada41d9b-d2de-4e95-a909-5f51acf55004 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:32.150367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1245/2519] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:32.153166 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfe2c5-fc6e-414c-9255-80a1d3d33836 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:32.156998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d4c5-6a1f-4282-9970-5d988208b749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:32.157656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d4c5-6a1f-4282-9970-5d988208b749 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:32.157936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d4c5-6a1f-4282-9970-5d988208b749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:32.158213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30d4c5-6a1f-4282-9970-5d988208b749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:32.168911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30d4c5-6a1f-4282-9970-5d988208b749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:32.170360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30d4c5-6a1f-4282-9970-5d988208b749 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:32.181788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1275/2520] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:32.221493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada41d9b-d2de-4e95-a909-5f51acf55004 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:32.230368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada41d9b-d2de-4e95-a909-5f51acf55004 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:32.234509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b47eb3-0e55-4a65-b062-247676642740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:32.235170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b47eb3-0e55-4a65-b062-247676642740 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:32.235454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b47eb3-0e55-4a65-b062-247676642740 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:32.235756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b47eb3-0e55-4a65-b062-247676642740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:32.295531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b47eb3-0e55-4a65-b062-247676642740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:32.297086 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b47eb3-0e55-4a65-b062-247676642740 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:32.307285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1246/2521] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:32.589574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d4c5-6a1f-4282-9970-5d988208b749 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:32.654599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30d4c5-6a1f-4282-9970-5d988208b749 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:32.659477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:32.660360 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:32.660643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:32.660949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] PATH_INFO: `/v3/users/0a6db1fac4da417188b6e9294d929e0f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:32.662154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6db1fac4da417188b6e9294d929e0f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:32.664081 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:32.666779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:32.721380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6db1fac4da417188b6e9294d929e0f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:32.722167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6db1fac4da417188b6e9294d929e0f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:32.731474 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6db1fac4da417188b6e9294d929e0f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:32.739288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6db1fac4da417188b6e9294d929e0f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:32.740353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6db1fac4da417188b6e9294d929e0f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:32.764524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1276/2522] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:35:32 2022] DELETE /identity/v3/users/0a6db1fac4da417188b6e9294d929e0f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:32.769140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01077e16-64fe-403d-923c-0cdb283c41fe None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:32.769449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01077e16-64fe-403d-923c-0cdb283c41fe None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:32.769730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01077e16-64fe-403d-923c-0cdb283c41fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:32.787597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-01077e16-64fe-403d-923c-0cdb283c41fe None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:32.788874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-01077e16-64fe-403d-923c-0cdb283c41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:32.861969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1247/2523] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:35:32.872047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:32.873553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:32.934576 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05067-54de-4db6-89bb-61a77373ef2c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:32.938583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8ef8f-161a-4f3f-9b42-77ae7cb7faad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:32.939222 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8ef8f-161a-4f3f-9b42-77ae7cb7faad service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:32.939504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8ef8f-161a-4f3f-9b42-77ae7cb7faad service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:32.939780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8ef8f-161a-4f3f-9b42-77ae7cb7faad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:32.949878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8ef8f-161a-4f3f-9b42-77ae7cb7faad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:32.951314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8ef8f-161a-4f3f-9b42-77ae7cb7faad service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:32.961162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1277/2524] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:33.250663 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01077e16-64fe-403d-923c-0cdb283c41fe None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:33.252160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-01077e16-64fe-403d-923c-0cdb283c41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:33.269347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01077e16-64fe-403d-923c-0cdb283c41fe None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:33.281428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:33.282312 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:33.282578 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:33.282852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] PATH_INFO: `/v3/projects/94b03ff677774589b356a1783c40ae5b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:33.284180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b03ff677774589b356a1783c40ae5b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:33.286168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:33.319860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:33.339181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b03ff677774589b356a1783c40ae5b', 'request_id': 'req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.345511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b03ff677774589b356a1783c40ae5b', 'request_id': 'req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.355162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b03ff677774589b356a1783c40ae5b', 'request_id': 'req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.370728 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] The token cache is being invalidate because project 94b03ff677774589b356a1783c40ae5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:35:33.371011 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.371712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.373362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1248/2525] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:35:33 2022] DELETE /identity/v3/projects/94b03ff677774589b356a1783c40ae5b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:33.377796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8ef8f-161a-4f3f-9b42-77ae7cb7faad service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:33.389206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8ef8f-161a-4f3f-9b42-77ae7cb7faad service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:33.456383 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:33.457473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:33.457848 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:33.458194 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] PATH_INFO: `/v3/users/30f894cf159c4351bc6b822448782bbb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:33.459444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=30f894cf159c4351bc6b822448782bbb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:33.461504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:33.494727 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:33.518022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30f894cf159c4351bc6b822448782bbb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.518619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30f894cf159c4351bc6b822448782bbb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.528363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30f894cf159c4351bc6b822448782bbb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.535777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30f894cf159c4351bc6b822448782bbb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.536460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-921d9c40-34d1-43bc-b5a7-200dc5e31fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30f894cf159c4351bc6b822448782bbb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:33.553652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1278/2526] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:35:33 2022] DELETE /identity/v3/users/30f894cf159c4351bc6b822448782bbb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:34.008598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:34.010207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:34.024339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba3ea0-ad56-46bf-9706-6a2a1d5b8314 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:34.092332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:34.093276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.093618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.093956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] PATH_INFO: `/v3/projects/433e583be3724fd5b82f0029ca3f4637` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.095233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=433e583be3724fd5b82f0029ca3f4637)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:34.097362 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:34.147103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '433e583be3724fd5b82f0029ca3f4637', 'request_id': 'req-6558c972-692a-48db-bb2e-e322132911cc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:34.153177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '433e583be3724fd5b82f0029ca3f4637', 'request_id': 'req-6558c972-692a-48db-bb2e-e322132911cc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:34.162471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '433e583be3724fd5b82f0029ca3f4637', 'request_id': 'req-6558c972-692a-48db-bb2e-e322132911cc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:34.174170 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] The token cache is being invalidate because project 433e583be3724fd5b82f0029ca3f4637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:35:34.174464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:34.175130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-6558c972-692a-48db-bb2e-e322132911cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:35:34.176706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1249/2527] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:35:34 2022] DELETE /identity/v3/projects/433e583be3724fd5b82f0029ca3f4637 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:35:34.182434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b20f5-c481-4348-b584-c23522ca2cce None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.182947 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b20f5-c481-4348-b584-c23522ca2cce None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.183069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b20f5-c481-4348-b584-c23522ca2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.201550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-d98b20f5-c481-4348-b584-c23522ca2cce None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:34.202761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d98b20f5-c481-4348-b584-c23522ca2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:34.263907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1279/2528] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:34.274210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f0e61-2c06-4784-b1cd-03aeac4d522a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.274715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f0e61-2c06-4784-b1cd-03aeac4d522a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.274814 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f0e61-2c06-4784-b1cd-03aeac4d522a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.301720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dc6f0e61-2c06-4784-b1cd-03aeac4d522a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:34.302920 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dc6f0e61-2c06-4784-b1cd-03aeac4d522a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:34.311870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1250/2529] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:34.316278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b20f5-c481-4348-b584-c23522ca2cce None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:34.326782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b20f5-c481-4348-b584-c23522ca2cce None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:34.332423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89dbad-470d-454d-8b82-55740b0ee7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:34.333153 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89dbad-470d-454d-8b82-55740b0ee7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.333438 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89dbad-470d-454d-8b82-55740b0ee7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.333699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89dbad-470d-454d-8b82-55740b0ee7ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.335370 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89dbad-470d-454d-8b82-55740b0ee7ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:35:34.335768 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89dbad-470d-454d-8b82-55740b0ee7ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:34.337532 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89dbad-470d-454d-8b82-55740b0ee7ad admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:34.350998 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1280/2530] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:35:34.355219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f0e61-2c06-4784-b1cd-03aeac4d522a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:34.364891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f0e61-2c06-4784-b1cd-03aeac4d522a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:34.370194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de251e8-17e6-44dc-a445-da2f0dc866ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:34.370864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de251e8-17e6-44dc-a445-da2f0dc866ad admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.371147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de251e8-17e6-44dc-a445-da2f0dc866ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.371423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de251e8-17e6-44dc-a445-da2f0dc866ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.372455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de251e8-17e6-44dc-a445-da2f0dc866ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:34.374399 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de251e8-17e6-44dc-a445-da2f0dc866ad admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:34.403746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1251/2531] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:35:34 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:35:34.407331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fa9b1-385a-44f0-93fa-5e99afcd9fb6 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.407620 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fa9b1-385a-44f0-93fa-5e99afcd9fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.407897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fa9b1-385a-44f0-93fa-5e99afcd9fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.408003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de251e8-17e6-44dc-a445-da2f0dc866ad admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:34.427057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3c2fa9b1-385a-44f0-93fa-5e99afcd9fb6 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:34.427235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:34.428311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3c2fa9b1-385a-44f0-93fa-5e99afcd9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:34.474976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de251e8-17e6-44dc-a445-da2f0dc866ad admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:34.480411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a4ba-64b1-4713-a001-0188b6ab14c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:34.481205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a4ba-64b1-4713-a001-0188b6ab14c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.481557 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a4ba-64b1-4713-a001-0188b6ab14c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.481888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a4ba-64b1-4713-a001-0188b6ab14c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.482674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0a4ba-64b1-4713-a001-0188b6ab14c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:34.484680 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0a4ba-64b1-4713-a001-0188b6ab14c1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:34.487211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1281/2532] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:34.499827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fa9b1-385a-44f0-93fa-5e99afcd9fb6 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:34.501433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3c2fa9b1-385a-44f0-93fa-5e99afcd9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:34.511383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1252/2533] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:35:34 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:35:34.515675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a4ba-64b1-4713-a001-0188b6ab14c1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:34.525479 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a4ba-64b1-4713-a001-0188b6ab14c1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:34.530569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75377ca9-5461-4ac1-91d4-158197ec5770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:34.531233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377ca9-5461-4ac1-91d4-158197ec5770 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.531519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377ca9-5461-4ac1-91d4-158197ec5770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.531801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377ca9-5461-4ac1-91d4-158197ec5770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.532526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75377ca9-5461-4ac1-91d4-158197ec5770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:34.534191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75377ca9-5461-4ac1-91d4-158197ec5770 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:34.541209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:34.545671 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1253/2534] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:35:34.549971 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75377ca9-5461-4ac1-91d4-158197ec5770 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:34.560432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75377ca9-5461-4ac1-91d4-158197ec5770 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:34.565171 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f32530-3641-4d3c-91d3-ae856d728d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:34.565950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f32530-3641-4d3c-91d3-ae856d728d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.566234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f32530-3641-4d3c-91d3-ae856d728d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.566509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f32530-3641-4d3c-91d3-ae856d728d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.567263 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f32530-3641-4d3c-91d3-ae856d728d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:34.568929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f32530-3641-4d3c-91d3-ae856d728d69 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:34.574514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fa9b1-385a-44f0-93fa-5e99afcd9fb6 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:34.580420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1254/2535] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:35:34.581478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa7a39-a856-4d2d-bc43-095164d5d392 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:34.582162 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa7a39-a856-4d2d-bc43-095164d5d392 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.582449 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa7a39-a856-4d2d-bc43-095164d5d392 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.582755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa7a39-a856-4d2d-bc43-095164d5d392 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.584546 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f32530-3641-4d3c-91d3-ae856d728d69 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:34.591784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa7a39-a856-4d2d-bc43-095164d5d392 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:34.593481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa7a39-a856-4d2d-bc43-095164d5d392 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:34.595490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f32530-3641-4d3c-91d3-ae856d728d69 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:34.600242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571382-c08e-493c-b04b-ef65f89a3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:34.601280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571382-c08e-493c-b04b-ef65f89a3baf admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.601509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571382-c08e-493c-b04b-ef65f89a3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.601634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1282/2536] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:35:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:35:34.601830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36571382-c08e-493c-b04b-ef65f89a3baf admin admin] PATH_INFO: `/v3/projects/243a010f919b4b48a2bdd26dac9d8e20/users/6c374513d75f4a559a4b21a53d8047d9/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.617863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571382-c08e-493c-b04b-ef65f89a3baf admin admin] RBAC: Authorizing `identity:create_grant(project_id=243a010f919b4b48a2bdd26dac9d8e20, user_id=6c374513d75f4a559a4b21a53d8047d9, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:34.620610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36571382-c08e-493c-b04b-ef65f89a3baf admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:34.634329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1255/2537] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:35:34 2022] PUT /identity/v3/projects/243a010f919b4b48a2bdd26dac9d8e20/users/6c374513d75f4a559a4b21a53d8047d9/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:35:34.645064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df983f08-1ab7-4af3-adfb-7f9f9e750818 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.645899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df983f08-1ab7-4af3-adfb-7f9f9e750818 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.646246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df983f08-1ab7-4af3-adfb-7f9f9e750818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.684624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-df983f08-1ab7-4af3-adfb-7f9f9e750818 None None] MFA Rules not processed for user `6c374513d75f4a559a4b21a53d8047d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:34.688051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-df983f08-1ab7-4af3-adfb-7f9f9e750818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:34.804595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1283/2538] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:34.813126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571382-c08e-493c-b04b-ef65f89a3baf admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:34.822928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-36571382-c08e-493c-b04b-ef65f89a3baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:34.941100 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36571382-c08e-493c-b04b-ef65f89a3baf admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:34.945596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc47116-f2a9-44df-9d70-006dafc34c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:34.946349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47116-f2a9-44df-9d70-006dafc34c60 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:34.946913 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47116-f2a9-44df-9d70-006dafc34c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:34.947265 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc47116-f2a9-44df-9d70-006dafc34c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:34.958424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc47116-f2a9-44df-9d70-006dafc34c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:34.960017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc47116-f2a9-44df-9d70-006dafc34c60 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:34.972987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1256/2539] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:43.260774 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df983f08-1ab7-4af3-adfb-7f9f9e750818 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:43.262291 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-df983f08-1ab7-4af3-adfb-7f9f9e750818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:43.336448 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df983f08-1ab7-4af3-adfb-7f9f9e750818 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:43.344955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5e7c8-001c-4eeb-9f4a-094a8d1eb4bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:43.345736 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e7c8-001c-4eeb-9f4a-094a8d1eb4bf service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:43.345987 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e7c8-001c-4eeb-9f4a-094a8d1eb4bf service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:43.346289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e7c8-001c-4eeb-9f4a-094a8d1eb4bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:43.348379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7fa5e7c8-001c-4eeb-9f4a-094a8d1eb4bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:43.402722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc47116-f2a9-44df-9d70-006dafc34c60 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:43.404971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:43.414080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc47116-f2a9-44df-9d70-006dafc34c60 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:43.418163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1ef86-762d-4ec9-9420-a74b0bd0f8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:43.418828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1ef86-762d-4ec9-9420-a74b0bd0f8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:43.419115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1ef86-762d-4ec9-9420-a74b0bd0f8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:43.419272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5e7c8-001c-4eeb-9f4a-094a8d1eb4bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:43.419369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1ef86-762d-4ec9-9420-a74b0bd0f8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:43.421428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-69f1ef86-762d-4ec9-9420-a74b0bd0f8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:43.422032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5e7c8-001c-4eeb-9f4a-094a8d1eb4bf service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:43.433601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1284/2540] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:35:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:35:43.499852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1ef86-762d-4ec9-9420-a74b0bd0f8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:43.502538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1ef86-762d-4ec9-9420-a74b0bd0f8a4 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:43.507612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:35:43.513289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1257/2541] 10.222.0.59 () {60 vars in 1396 bytes} [Fri Jul 1 16:35:43 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:35:50.364516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02043dce-a078-4343-9dc8-0b74bdb1d9e8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:50.365311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02043dce-a078-4343-9dc8-0b74bdb1d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:50.365430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02043dce-a078-4343-9dc8-0b74bdb1d9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:50.388526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-02043dce-a078-4343-9dc8-0b74bdb1d9e8 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:35:50.389814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-02043dce-a078-4343-9dc8-0b74bdb1d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:35:50.447244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1285/2542] 10.222.0.59 () {58 vars in 967 bytes} [Fri Jul 1 16:35:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:35:50.459610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1ef86-762d-4ec9-9420-a74b0bd0f8a4 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:35:50.527587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1ef86-762d-4ec9-9420-a74b0bd0f8a4 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:35:50.533476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542c293-0464-4774-a8da-cade0dbaf704 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:35:50.534209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542c293-0464-4774-a8da-cade0dbaf704 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:35:50.534492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542c293-0464-4774-a8da-cade0dbaf704 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:35:50.534772 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542c293-0464-4774-a8da-cade0dbaf704 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:35:50.544173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542c293-0464-4774-a8da-cade0dbaf704 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:35:50.545835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542c293-0464-4774-a8da-cade0dbaf704 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:35:50.554902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1258/2543] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:35:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:36:00.440159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=29 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:00.550779 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=32 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:03.370241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02043dce-a078-4343-9dc8-0b74bdb1d9e8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:03.371960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-02043dce-a078-4343-9dc8-0b74bdb1d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:03.430231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02043dce-a078-4343-9dc8-0b74bdb1d9e8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:03.434933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832fa2f-fe9a-4c0e-9b81-ee8100f87c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:03.435623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832fa2f-fe9a-4c0e-9b81-ee8100f87c61 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:03.435907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832fa2f-fe9a-4c0e-9b81-ee8100f87c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:03.436183 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832fa2f-fe9a-4c0e-9b81-ee8100f87c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:03.438502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8832fa2f-fe9a-4c0e-9b81-ee8100f87c61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:03.506472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832fa2f-fe9a-4c0e-9b81-ee8100f87c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:03.507904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832fa2f-fe9a-4c0e-9b81-ee8100f87c61 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:03.518060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1286/2544] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:05.180245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542c293-0464-4774-a8da-cade0dbaf704 service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:05.190308 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542c293-0464-4774-a8da-cade0dbaf704 service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:05.194911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:05.195794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:05.196071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:05.196344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] PATH_INFO: `/v3/users/6c374513d75f4a559a4b21a53d8047d9` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:05.197573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c374513d75f4a559a4b21a53d8047d9)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:05.199596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:05.254417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c374513d75f4a559a4b21a53d8047d9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:05.255193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c374513d75f4a559a4b21a53d8047d9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:05.255869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c374513d75f4a559a4b21a53d8047d9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:05.268702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c374513d75f4a559a4b21a53d8047d9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:05.276155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c374513d75f4a559a4b21a53d8047d9'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:05.295306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1259/2545] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:05 2022] DELETE /identity/v3/users/6c374513d75f4a559a4b21a53d8047d9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:05.297412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540b885-c6a2-453d-adee-a42de790d11b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:05.297974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540b885-c6a2-453d-adee-a42de790d11b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:05.298180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540b885-c6a2-453d-adee-a42de790d11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:05.315892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8540b885-c6a2-453d-adee-a42de790d11b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:05.319693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8540b885-c6a2-453d-adee-a42de790d11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:05.387433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1287/2546] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:05.398363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:05.400034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:05.476672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcd472-46ae-4ad5-b495-e221646869bc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:05.481358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54c51b-79fd-4736-84cc-503955a0bc9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:05.482131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c51b-79fd-4736-84cc-503955a0bc9c service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:05.482515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c51b-79fd-4736-84cc-503955a0bc9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:05.482888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c51b-79fd-4736-84cc-503955a0bc9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:05.493911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54c51b-79fd-4736-84cc-503955a0bc9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:05.496742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54c51b-79fd-4736-84cc-503955a0bc9c service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:05.508138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1260/2547] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:36:05.937488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540b885-c6a2-453d-adee-a42de790d11b None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:05.940504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8540b885-c6a2-453d-adee-a42de790d11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:05.957882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540b885-c6a2-453d-adee-a42de790d11b None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:05.963193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:05.964362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:05.964483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:05.964750 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] PATH_INFO: `/v3/projects/243a010f919b4b48a2bdd26dac9d8e20` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:05.966014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=243a010f919b4b48a2bdd26dac9d8e20)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:05.967980 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:06.021412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:06.025059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '243a010f919b4b48a2bdd26dac9d8e20', 'request_id': 'req-fe4735b4-f0ce-4935-a749-4a82bf721f48'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:06.033238 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '243a010f919b4b48a2bdd26dac9d8e20', 'request_id': 'req-fe4735b4-f0ce-4935-a749-4a82bf721f48'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:06.043232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '243a010f919b4b48a2bdd26dac9d8e20', 'request_id': 'req-fe4735b4-f0ce-4935-a749-4a82bf721f48'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:06.056075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] The token cache is being invalidate because project 243a010f919b4b48a2bdd26dac9d8e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:06.056363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:06.057036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fe4735b4-f0ce-4935-a749-4a82bf721f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:06.058753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1288/2548] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:05 2022] DELETE /identity/v3/projects/243a010f919b4b48a2bdd26dac9d8e20 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:06.064150 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b345-331c-432e-8eb6-bd5cbb45c640 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.064478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b345-331c-432e-8eb6-bd5cbb45c640 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.064725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b345-331c-432e-8eb6-bd5cbb45c640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.082564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-fe02b345-331c-432e-8eb6-bd5cbb45c640 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:06.083784 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-fe02b345-331c-432e-8eb6-bd5cbb45c640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:06.155733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1261/2549] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:06.222634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84864d-4d49-470a-a1a3-ba3022fe92ae None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.223236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84864d-4d49-470a-a1a3-ba3022fe92ae None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.223586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84864d-4d49-470a-a1a3-ba3022fe92ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.251046 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3c84864d-4d49-470a-a1a3-ba3022fe92ae None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:06.252336 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3c84864d-4d49-470a-a1a3-ba3022fe92ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:06.263651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1289/2550] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:06.264774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02b345-331c-432e-8eb6-bd5cbb45c640 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:06.274447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02b345-331c-432e-8eb6-bd5cbb45c640 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:06.279336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207798e-f226-4f0f-9b67-2fc1c736b266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:06.279942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207798e-f226-4f0f-9b67-2fc1c736b266 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.280220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207798e-f226-4f0f-9b67-2fc1c736b266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.280492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207798e-f226-4f0f-9b67-2fc1c736b266 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.281292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207798e-f226-4f0f-9b67-2fc1c736b266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:36:06.281596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207798e-f226-4f0f-9b67-2fc1c736b266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:06.283369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207798e-f226-4f0f-9b67-2fc1c736b266 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:06.297243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1262/2551] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 01 16:36:06.302154 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84864d-4d49-470a-a1a3-ba3022fe92ae None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:06.312594 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84864d-4d49-470a-a1a3-ba3022fe92ae None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:06.317191 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c673fe-017b-4359-b6f0-fade8f584eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:06.317844 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c673fe-017b-4359-b6f0-fade8f584eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.318118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c673fe-017b-4359-b6f0-fade8f584eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.318385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c673fe-017b-4359-b6f0-fade8f584eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.319069 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c673fe-017b-4359-b6f0-fade8f584eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:06.321244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c673fe-017b-4359-b6f0-fade8f584eb2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:06.360873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1290/2552] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:06 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:06.364590 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207798e-f226-4f0f-9b67-2fc1c736b266 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:06.369867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:06.376613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207798e-f226-4f0f-9b67-2fc1c736b266 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:06.443040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9148b97-d872-4144-be0a-07faa7550fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:06.443793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9148b97-d872-4144-be0a-07faa7550fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.444081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9148b97-d872-4144-be0a-07faa7550fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.444382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9148b97-d872-4144-be0a-07faa7550fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.445183 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9148b97-d872-4144-be0a-07faa7550fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:06.447384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9148b97-d872-4144-be0a-07faa7550fa4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:06.473218 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1263/2553] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:06 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:06.475359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c673fe-017b-4359-b6f0-fade8f584eb2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:06.485910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c673fe-017b-4359-b6f0-fade8f584eb2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:06.490496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124b8ce-da00-4cb0-825a-9ca2267958ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:06.491163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124b8ce-da00-4cb0-825a-9ca2267958ab admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.491446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124b8ce-da00-4cb0-825a-9ca2267958ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.491720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124b8ce-da00-4cb0-825a-9ca2267958ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.492447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124b8ce-da00-4cb0-825a-9ca2267958ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:06.494094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124b8ce-da00-4cb0-825a-9ca2267958ab admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:06.508065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1291/2554] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:06.509314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9148b97-d872-4144-be0a-07faa7550fa4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:06.519864 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9148b97-d872-4144-be0a-07faa7550fa4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:06.524526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323a6b4-3fb0-42b1-a018-35e31167240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:06.525255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323a6b4-3fb0-42b1-a018-35e31167240b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.525674 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323a6b4-3fb0-42b1-a018-35e31167240b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.525988 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323a6b4-3fb0-42b1-a018-35e31167240b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.526733 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323a6b4-3fb0-42b1-a018-35e31167240b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:06.528353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323a6b4-3fb0-42b1-a018-35e31167240b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:06.538758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1264/2555] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:06.543200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124b8ce-da00-4cb0-825a-9ca2267958ab admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:06.553417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124b8ce-da00-4cb0-825a-9ca2267958ab admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:06.558344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67836fe-d258-4fff-8f14-77cb21b50e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:06.559233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67836fe-d258-4fff-8f14-77cb21b50e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.559536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67836fe-d258-4fff-8f14-77cb21b50e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.559804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67836fe-d258-4fff-8f14-77cb21b50e5e admin admin] PATH_INFO: `/v3/projects/45c4b4d8fa0e4e56b86e4939d4ad7428/users/310d6d84d14b469192bc49133aea747b/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.582102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67836fe-d258-4fff-8f14-77cb21b50e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c4b4d8fa0e4e56b86e4939d4ad7428, user_id=310d6d84d14b469192bc49133aea747b, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:06.584828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67836fe-d258-4fff-8f14-77cb21b50e5e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:06.609826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1292/2556] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:06 2022] PUT /identity/v3/projects/45c4b4d8fa0e4e56b86e4939d4ad7428/users/310d6d84d14b469192bc49133aea747b/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:06.626127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d37f8-25da-42df-bbdd-e2b4d584be5d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.626789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d37f8-25da-42df-bbdd-e2b4d584be5d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.627316 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d37f8-25da-42df-bbdd-e2b4d584be5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.663424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-ae8d37f8-25da-42df-bbdd-e2b4d584be5d None None] MFA Rules not processed for user `310d6d84d14b469192bc49133aea747b`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:06.665586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ae8d37f8-25da-42df-bbdd-e2b4d584be5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:06.759074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1265/2557] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:06.770613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67836fe-d258-4fff-8f14-77cb21b50e5e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:06.772596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a67836fe-d258-4fff-8f14-77cb21b50e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:06.842707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67836fe-d258-4fff-8f14-77cb21b50e5e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:06.846339 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0482-084b-44d8-a866-8a7edc3612fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:06.847045 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0482-084b-44d8-a866-8a7edc3612fa service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.847326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0482-084b-44d8-a866-8a7edc3612fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.847600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe0482-084b-44d8-a866-8a7edc3612fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.860582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0482-084b-44d8-a866-8a7edc3612fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:06.863002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe0482-084b-44d8-a866-8a7edc3612fa service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:06.872868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1293/2558] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:06.914634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d37f8-25da-42df-bbdd-e2b4d584be5d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:06.916006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ae8d37f8-25da-42df-bbdd-e2b4d584be5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:06.988460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d37f8-25da-42df-bbdd-e2b4d584be5d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:06.993173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:06.994141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:06.994426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:06.994758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] PATH_INFO: `/v3/users/5d773059c4b34e3e9c19e8355093266f` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:06.996088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d773059c4b34e3e9c19e8355093266f)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:06.998088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:07.011765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:07.050427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d773059c4b34e3e9c19e8355093266f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.051201 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d773059c4b34e3e9c19e8355093266f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.051882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d773059c4b34e3e9c19e8355093266f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.065896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d773059c4b34e3e9c19e8355093266f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.074154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9ebfc25d-7f58-46ce-9c77-b7de0065d6ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d773059c4b34e3e9c19e8355093266f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.096961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1266/2559] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:06 2022] DELETE /identity/v3/users/5d773059c4b34e3e9c19e8355093266f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:07.301728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0482-084b-44d8-a866-8a7edc3612fa service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:07.315935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe0482-084b-44d8-a866-8a7edc3612fa service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:07.392226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:07.393136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.393438 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.393706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] PATH_INFO: `/v3/projects/f2c0a59053d04aaeb9a8751b76b55deb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.394933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c0a59053d04aaeb9a8751b76b55deb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:07.396946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:07.413159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:07.446806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c0a59053d04aaeb9a8751b76b55deb', 'request_id': 'req-31f8c27f-abed-430a-be83-c838dfdb4dee'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.452341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c0a59053d04aaeb9a8751b76b55deb', 'request_id': 'req-31f8c27f-abed-430a-be83-c838dfdb4dee'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.461073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c0a59053d04aaeb9a8751b76b55deb', 'request_id': 'req-31f8c27f-abed-430a-be83-c838dfdb4dee'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.475039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] The token cache is being invalidate because project f2c0a59053d04aaeb9a8751b76b55deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:07.475329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.476167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-31f8c27f-abed-430a-be83-c838dfdb4dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:07.477936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1294/2560] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:07 2022] DELETE /identity/v3/projects/f2c0a59053d04aaeb9a8751b76b55deb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:07.483234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d7252-ecab-4c28-9b1e-f77fda37a396 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.483734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d7252-ecab-4c28-9b1e-f77fda37a396 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.483734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d7252-ecab-4c28-9b1e-f77fda37a396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.504997 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-dc7d7252-ecab-4c28-9b1e-f77fda37a396 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:07.506236 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-dc7d7252-ecab-4c28-9b1e-f77fda37a396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:07.573292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1267/2561] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:07.582116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f907927-6eb3-437e-ac6f-d7b85c8d09cf None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.582454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f907927-6eb3-437e-ac6f-d7b85c8d09cf None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.582787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f907927-6eb3-437e-ac6f-d7b85c8d09cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.603067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3f907927-6eb3-437e-ac6f-d7b85c8d09cf None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:07.604353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3f907927-6eb3-437e-ac6f-d7b85c8d09cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:07.618601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1295/2562] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:07.620027 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d7252-ecab-4c28-9b1e-f77fda37a396 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:07.630937 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d7252-ecab-4c28-9b1e-f77fda37a396 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:07.636195 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd421bd-81a8-4e15-bf9b-61b2ae548984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:07.636883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd421bd-81a8-4e15-bf9b-61b2ae548984 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.637353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd421bd-81a8-4e15-bf9b-61b2ae548984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.637744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd421bd-81a8-4e15-bf9b-61b2ae548984 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.638478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd421bd-81a8-4e15-bf9b-61b2ae548984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:36:07.638831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd421bd-81a8-4e15-bf9b-61b2ae548984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:07.640492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd421bd-81a8-4e15-bf9b-61b2ae548984 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:07.653069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1268/2563] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:36:07.657502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f907927-6eb3-437e-ac6f-d7b85c8d09cf None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:07.666973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f907927-6eb3-437e-ac6f-d7b85c8d09cf None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:07.672698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2142e-0cb4-4741-9c9a-1f8976b94e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:07.673418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2142e-0cb4-4741-9c9a-1f8976b94e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.673696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2142e-0cb4-4741-9c9a-1f8976b94e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.673965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2142e-0cb4-4741-9c9a-1f8976b94e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.674659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2142e-0cb4-4741-9c9a-1f8976b94e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:07.676585 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2142e-0cb4-4741-9c9a-1f8976b94e58 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:07.704648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1296/2564] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:07 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:36:07.708968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd421bd-81a8-4e15-bf9b-61b2ae548984 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:07.720207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd421bd-81a8-4e15-bf9b-61b2ae548984 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:07.779276 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400bdbd-e451-4d1c-8665-dda6f3207483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:07.779940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400bdbd-e451-4d1c-8665-dda6f3207483 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.780219 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400bdbd-e451-4d1c-8665-dda6f3207483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.780494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400bdbd-e451-4d1c-8665-dda6f3207483 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.781220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400bdbd-e451-4d1c-8665-dda6f3207483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:07.783205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400bdbd-e451-4d1c-8665-dda6f3207483 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:07.806230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1269/2565] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:07 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:07.810688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2142e-0cb4-4741-9c9a-1f8976b94e58 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:07.821210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2142e-0cb4-4741-9c9a-1f8976b94e58 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:07.826853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14430-2cea-43b4-b114-6c43840e5e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:07.827454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14430-2cea-43b4-b114-6c43840e5e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.827729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14430-2cea-43b4-b114-6c43840e5e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.827996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14430-2cea-43b4-b114-6c43840e5e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.828720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d14430-2cea-43b4-b114-6c43840e5e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:07.830355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d14430-2cea-43b4-b114-6c43840e5e28 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:07.841568 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1297/2566] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:07.845668 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400bdbd-e451-4d1c-8665-dda6f3207483 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:07.857636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400bdbd-e451-4d1c-8665-dda6f3207483 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:07.863188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78736f84-3a16-4b6c-a64a-0c1cb06a9c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:07.863849 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78736f84-3a16-4b6c-a64a-0c1cb06a9c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.864124 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78736f84-3a16-4b6c-a64a-0c1cb06a9c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.864389 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78736f84-3a16-4b6c-a64a-0c1cb06a9c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.865140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78736f84-3a16-4b6c-a64a-0c1cb06a9c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:07.866740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78736f84-3a16-4b6c-a64a-0c1cb06a9c68 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:07.867945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:07.878868 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1270/2567] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:07.883273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14430-2cea-43b4-b114-6c43840e5e28 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:07.894284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14430-2cea-43b4-b114-6c43840e5e28 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:07.899331 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c06781-2406-4b42-be1d-2fa09aeb9234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:07.900212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c06781-2406-4b42-be1d-2fa09aeb9234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.900501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c06781-2406-4b42-be1d-2fa09aeb9234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.900765 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c06781-2406-4b42-be1d-2fa09aeb9234 admin admin] PATH_INFO: `/v3/projects/2f041236bc10419dadb06ad049284960/users/1c2091b96cb242efbddbc41b643829d0/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.917149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c06781-2406-4b42-be1d-2fa09aeb9234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f041236bc10419dadb06ad049284960, user_id=1c2091b96cb242efbddbc41b643829d0, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:07.919898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c06781-2406-4b42-be1d-2fa09aeb9234 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:07.935779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1298/2568] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:07 2022] PUT /identity/v3/projects/2f041236bc10419dadb06ad049284960/users/1c2091b96cb242efbddbc41b643829d0/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:07.947211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396174a-b7c6-4c70-b6c1-1ba055df7e52 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:07.947577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396174a-b7c6-4c70-b6c1-1ba055df7e52 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:07.947872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396174a-b7c6-4c70-b6c1-1ba055df7e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:07.975488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-c396174a-b7c6-4c70-b6c1-1ba055df7e52 None None] MFA Rules not processed for user `1c2091b96cb242efbddbc41b643829d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:07.976759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c396174a-b7c6-4c70-b6c1-1ba055df7e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:08.044488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1271/2569] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:08.049393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c06781-2406-4b42-be1d-2fa09aeb9234 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:08.113933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c06781-2406-4b42-be1d-2fa09aeb9234 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:08.119272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb703a-4c87-4ea1-ade6-f30ef8a29433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:08.119946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb703a-4c87-4ea1-ade6-f30ef8a29433 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.120345 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb703a-4c87-4ea1-ade6-f30ef8a29433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.120630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb703a-4c87-4ea1-ade6-f30ef8a29433 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.121365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb703a-4c87-4ea1-ade6-f30ef8a29433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:08.123363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb703a-4c87-4ea1-ade6-f30ef8a29433 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:08.153550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1299/2570] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:08 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:08.157938 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396174a-b7c6-4c70-b6c1-1ba055df7e52 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:08.170085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396174a-b7c6-4c70-b6c1-1ba055df7e52 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:08.230149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979702e-eb0d-4ff5-938f-01b57fdfda04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:08.230836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979702e-eb0d-4ff5-938f-01b57fdfda04 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.231123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979702e-eb0d-4ff5-938f-01b57fdfda04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.231401 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979702e-eb0d-4ff5-938f-01b57fdfda04 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.232096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979702e-eb0d-4ff5-938f-01b57fdfda04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:08.234134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979702e-eb0d-4ff5-938f-01b57fdfda04 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:08.255282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc0d45-3959-4b50-9b24-bbf770b1b547 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.255563 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc0d45-3959-4b50-9b24-bbf770b1b547 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.255834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc0d45-3959-4b50-9b24-bbf770b1b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.257194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1272/2571] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:08 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:36:08.261090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979702e-eb0d-4ff5-938f-01b57fdfda04 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:08.270843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979702e-eb0d-4ff5-938f-01b57fdfda04 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:08.273558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0ddc0d45-3959-4b50-9b24-bbf770b1b547 None None] MFA Rules not processed for user `310d6d84d14b469192bc49133aea747b`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:08.274771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0ddc0d45-3959-4b50-9b24-bbf770b1b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:08.275762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa22caa-bcbe-4499-b251-07baf3bafe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:08.276419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa22caa-bcbe-4499-b251-07baf3bafe9e admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.276697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa22caa-bcbe-4499-b251-07baf3bafe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.277005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa22caa-bcbe-4499-b251-07baf3bafe9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.277732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa22caa-bcbe-4499-b251-07baf3bafe9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:08.279416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa22caa-bcbe-4499-b251-07baf3bafe9e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:08.289858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1273/2572] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:36:08.293571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:08.293954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa22caa-bcbe-4499-b251-07baf3bafe9e admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:08.304163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa22caa-bcbe-4499-b251-07baf3bafe9e admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:08.309751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ba73f-9559-48ac-8246-413de221a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:08.310667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ba73f-9559-48ac-8246-413de221a471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.310948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ba73f-9559-48ac-8246-413de221a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.311222 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ba73f-9559-48ac-8246-413de221a471 admin admin] PATH_INFO: `/v3/projects/32250764869d4270a721cb76f90f0b6e/users/d41ee4c574ec4ac3bebfe9a1ac5d4060/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.326225 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ba73f-9559-48ac-8246-413de221a471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32250764869d4270a721cb76f90f0b6e, user_id=d41ee4c574ec4ac3bebfe9a1ac5d4060, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:08.328966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ba73f-9559-48ac-8246-413de221a471 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:08.333142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1300/2573] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:36:08.344033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1274/2574] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:08 2022] PUT /identity/v3/projects/32250764869d4270a721cb76f90f0b6e/users/d41ee4c574ec4ac3bebfe9a1ac5d4060/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:36:08.347828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc0d45-3959-4b50-9b24-bbf770b1b547 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:08.358870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc0d45-3959-4b50-9b24-bbf770b1b547 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:08.416558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838c4ba-c167-4d8f-b852-2484ac3ed4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:08.417285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838c4ba-c167-4d8f-b852-2484ac3ed4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.417560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838c4ba-c167-4d8f-b852-2484ac3ed4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.417826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838c4ba-c167-4d8f-b852-2484ac3ed4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.418583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838c4ba-c167-4d8f-b852-2484ac3ed4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:08.420174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838c4ba-c167-4d8f-b852-2484ac3ed4f7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:08.430739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1301/2575] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:08.435207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ba73f-9559-48ac-8246-413de221a471 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:08.445711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ba73f-9559-48ac-8246-413de221a471 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:08.450326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545624b2-b22a-4d7e-90c4-08c04a1dc078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:08.451304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545624b2-b22a-4d7e-90c4-08c04a1dc078 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.451587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545624b2-b22a-4d7e-90c4-08c04a1dc078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.451859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545624b2-b22a-4d7e-90c4-08c04a1dc078 admin admin] PATH_INFO: `/v3/projects/32250764869d4270a721cb76f90f0b6e/users/d41ee4c574ec4ac3bebfe9a1ac5d4060/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.453890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545624b2-b22a-4d7e-90c4-08c04a1dc078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32250764869d4270a721cb76f90f0b6e, user_id=d41ee4c574ec4ac3bebfe9a1ac5d4060, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:08.456540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545624b2-b22a-4d7e-90c4-08c04a1dc078 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:08.467695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1275/2576] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:08 2022] PUT /identity/v3/projects/32250764869d4270a721cb76f90f0b6e/users/d41ee4c574ec4ac3bebfe9a1ac5d4060/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:36:08.478201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667db9e-15e0-46b3-95c6-02dc74a7c25e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.478489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667db9e-15e0-46b3-95c6-02dc74a7c25e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.478763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667db9e-15e0-46b3-95c6-02dc74a7c25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.505240 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5667db9e-15e0-46b3-95c6-02dc74a7c25e None None] MFA Rules not processed for user `d41ee4c574ec4ac3bebfe9a1ac5d4060`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:08.506499 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5667db9e-15e0-46b3-95c6-02dc74a7c25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:08.578502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1302/2577] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:08.591040 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545624b2-b22a-4d7e-90c4-08c04a1dc078 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:08.592766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-545624b2-b22a-4d7e-90c4-08c04a1dc078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:08.628324 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:08.654420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545624b2-b22a-4d7e-90c4-08c04a1dc078 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:08.658238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1453-8d6a-4320-a0b8-61f13eb0faf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:08.658899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1453-8d6a-4320-a0b8-61f13eb0faf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.659182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1453-8d6a-4320-a0b8-61f13eb0faf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.659450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1453-8d6a-4320-a0b8-61f13eb0faf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.669361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d1453-8d6a-4320-a0b8-61f13eb0faf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:08.670817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d1453-8d6a-4320-a0b8-61f13eb0faf7 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:08.681484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1276/2578] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:08.760996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667db9e-15e0-46b3-95c6-02dc74a7c25e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:08.772454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667db9e-15e0-46b3-95c6-02dc74a7c25e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:08.776070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee46fb9-5a1a-4df1-8f75-215347cbeeee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:08.776780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46fb9-5a1a-4df1-8f75-215347cbeeee service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.777359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46fb9-5a1a-4df1-8f75-215347cbeeee service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.777695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee46fb9-5a1a-4df1-8f75-215347cbeeee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.827420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1453-8d6a-4320-a0b8-61f13eb0faf7 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:08.829137 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-188d1453-8d6a-4320-a0b8-61f13eb0faf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:08.848904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:08.865771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee46fb9-5a1a-4df1-8f75-215347cbeeee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:08.865771 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee46fb9-5a1a-4df1-8f75-215347cbeeee service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:08.878023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1303/2579] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:36:08.912327 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1453-8d6a-4320-a0b8-61f13eb0faf7 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:08.917555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:08.918287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:08.918724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:08.919067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:08.921019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:08.933370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:08.935064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:08.945900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1277/2580] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:10.941725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee46fb9-5a1a-4df1-8f75-215347cbeeee service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:10.943207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3ee46fb9-5a1a-4df1-8f75-215347cbeeee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:11.009922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee46fb9-5a1a-4df1-8f75-215347cbeeee service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:11.014117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:11.014863 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:11.015148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:11.015424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:11.017518 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:11.029413 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:11.030889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:11.039834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1304/2581] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:11.763928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:11.766306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:11.852449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb15f5-94f0-4043-b278-56a24d6add78 service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:11.858109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b85a0-ce1a-4870-a3bf-c39518dc57a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:11.859053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b85a0-ce1a-4870-a3bf-c39518dc57a5 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:11.859154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b85a0-ce1a-4870-a3bf-c39518dc57a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:11.859463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b85a0-ce1a-4870-a3bf-c39518dc57a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:11.861445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-853b85a0-ce1a-4870-a3bf-c39518dc57a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:11.875003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b85a0-ce1a-4870-a3bf-c39518dc57a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:11.876737 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b85a0-ce1a-4870-a3bf-c39518dc57a5 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:11.888896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1278/2582] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:18.257128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:18.258520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:18.275089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca252724-3519-4f5d-bfda-38522b71918e service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:18.280876 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:18.281397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:18.281675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:18.281950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:18.283757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:18.296917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:18.298523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:18.309781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1305/2583] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:21.883566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=80 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:24.446442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4ecc-ea36-4f99-8ef1-aa81638f839c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:24.447045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4ecc-ea36-4f99-8ef1-aa81638f839c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:24.447045 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4ecc-ea36-4f99-8ef1-aa81638f839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:24.465348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d3ec4ecc-ea36-4f99-8ef1-aa81638f839c None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:24.466562 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d3ec4ecc-ea36-4f99-8ef1-aa81638f839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:24.523474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1279/2584] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:24.545952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:24.547504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:24.619802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bb70c-649d-4622-bd90-03e578e62d82 service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:24.626297 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c08ea-fb5e-40a9-b226-73a44a44b7b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:24.627072 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c08ea-fb5e-40a9-b226-73a44a44b7b3 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:24.627405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c08ea-fb5e-40a9-b226-73a44a44b7b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:24.627717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c08ea-fb5e-40a9-b226-73a44a44b7b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:24.637556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c08ea-fb5e-40a9-b226-73a44a44b7b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:24.640023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c08ea-fb5e-40a9-b226-73a44a44b7b3 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:24.653309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1306/2585] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:36:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:36:25.212620 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acef56-f87e-4db6-9647-c1838395d73a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:25.212946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acef56-f87e-4db6-9647-c1838395d73a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:25.213233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46acef56-f87e-4db6-9647-c1838395d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:25.233775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-46acef56-f87e-4db6-9647-c1838395d73a None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:25.234981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-46acef56-f87e-4db6-9647-c1838395d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:25.243689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1280/2586] 10.222.0.59 () {58 vars in 967 bytes} [Fri Jul 1 16:36:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:25.256029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c08ea-fb5e-40a9-b226-73a44a44b7b3 service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:25.267428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c08ea-fb5e-40a9-b226-73a44a44b7b3 service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:25.275285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeeebd-34c4-44a8-b783-4cf1c8f7d2c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:25.276075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeeebd-34c4-44a8-b783-4cf1c8f7d2c1 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:25.276358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeeebd-34c4-44a8-b783-4cf1c8f7d2c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:25.276633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdeeebd-34c4-44a8-b783-4cf1c8f7d2c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:25.285686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdeeebd-34c4-44a8-b783-4cf1c8f7d2c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:25.287333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdeeebd-34c4-44a8-b783-4cf1c8f7d2c1 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:25.295836 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1307/2587] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:36:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:36:25.501034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730283-5c29-4a02-81df-fd645af5eee0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:25.501534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730283-5c29-4a02-81df-fd645af5eee0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:25.501615 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b730283-5c29-4a02-81df-fd645af5eee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:25.521728 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4b730283-5c29-4a02-81df-fd645af5eee0 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:25.523126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4b730283-5c29-4a02-81df-fd645af5eee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:25.531879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1281/2588] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:36:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:25.545695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeeebd-34c4-44a8-b783-4cf1c8f7d2c1 service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:25.557173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdeeebd-34c4-44a8-b783-4cf1c8f7d2c1 service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:25.563002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2f495-5e5b-4ed8-8148-43d81706e4f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:25.563756 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2f495-5e5b-4ed8-8148-43d81706e4f1 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:25.564098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2f495-5e5b-4ed8-8148-43d81706e4f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:25.564433 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2f495-5e5b-4ed8-8148-43d81706e4f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:25.572905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2f495-5e5b-4ed8-8148-43d81706e4f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:25.574610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2f495-5e5b-4ed8-8148-43d81706e4f1 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:25.582944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1308/2589] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:36:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 16:36:25.920815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9b0b7-42fc-4aa9-a3e4-0529e076c39d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:25.921140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9b0b7-42fc-4aa9-a3e4-0529e076c39d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:25.921423 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9b0b7-42fc-4aa9-a3e4-0529e076c39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:25.940008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-88f9b0b7-42fc-4aa9-a3e4-0529e076c39d None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:25.941181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-88f9b0b7-42fc-4aa9-a3e4-0529e076c39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:25.949651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1282/2590] 10.222.0.59 () {58 vars in 967 bytes} [Fri Jul 1 16:36:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:25.961979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2f495-5e5b-4ed8-8148-43d81706e4f1 service swift] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:25.973422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2f495-5e5b-4ed8-8148-43d81706e4f1 service swift] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:25.978882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f81af2-6499-4fa8-b23c-f4b60e229ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:25.979530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81af2-6499-4fa8-b23c-f4b60e229ff8 service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:25.979813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81af2-6499-4fa8-b23c-f4b60e229ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:25.980090 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f81af2-6499-4fa8-b23c-f4b60e229ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:25.988966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f81af2-6499-4fa8-b23c-f4b60e229ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:25.996994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f81af2-6499-4fa8-b23c-f4b60e229ff8 service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:26.006126 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1309/2591] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:36:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 01 16:36:28.127448 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9b0b7-42fc-4aa9-a3e4-0529e076c39d None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:28.129028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-88f9b0b7-42fc-4aa9-a3e4-0529e076c39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:28.207290 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9b0b7-42fc-4aa9-a3e4-0529e076c39d None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:28.213910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:28.214873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:28.215595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:28.215873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] PATH_INFO: `/v3/users/310d6d84d14b469192bc49133aea747b` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:28.217483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=310d6d84d14b469192bc49133aea747b)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:28.219748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:28.278122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310d6d84d14b469192bc49133aea747b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.278886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310d6d84d14b469192bc49133aea747b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.279488 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310d6d84d14b469192bc49133aea747b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.292187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310d6d84d14b469192bc49133aea747b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.299084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310d6d84d14b469192bc49133aea747b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.313256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1283/2592] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:28 2022] DELETE /identity/v3/users/310d6d84d14b469192bc49133aea747b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:28.317798 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a677f-28f7-4cab-a312-c3aff1af4d0f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:28.318295 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a677f-28f7-4cab-a312-c3aff1af4d0f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:28.318408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086a677f-28f7-4cab-a312-c3aff1af4d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:28.337425 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-086a677f-28f7-4cab-a312-c3aff1af4d0f None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:28.338644 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-086a677f-28f7-4cab-a312-c3aff1af4d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:28.363561 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:28.401834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1310/2593] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:36:28.411642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:28.413096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:28.420393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:28.473623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97211101-64de-4588-a806-5a34a5483f5a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:28.477494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c88bb-ad17-4d70-95f1-3a180c363166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:28.478152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c88bb-ad17-4d70-95f1-3a180c363166 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:28.478413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c88bb-ad17-4d70-95f1-3a180c363166 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:28.478676 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c88bb-ad17-4d70-95f1-3a180c363166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:28.489221 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c88bb-ad17-4d70-95f1-3a180c363166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:28.490942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c88bb-ad17-4d70-95f1-3a180c363166 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:28.501859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1284/2594] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:36:28.697207 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a677f-28f7-4cab-a312-c3aff1af4d0f None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:28.699857 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-086a677f-28f7-4cab-a312-c3aff1af4d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:28.717640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086a677f-28f7-4cab-a312-c3aff1af4d0f None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:28.729301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:28.729962 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:28.731180 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:28.731661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] PATH_INFO: `/v3/projects/45c4b4d8fa0e4e56b86e4939d4ad7428` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:28.734091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c4b4d8fa0e4e56b86e4939d4ad7428)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:28.736789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:28.807334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c4b4d8fa0e4e56b86e4939d4ad7428', 'request_id': 'req-ae443bd7-240d-4849-8a7d-f39714f4d45f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.813744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c4b4d8fa0e4e56b86e4939d4ad7428', 'request_id': 'req-ae443bd7-240d-4849-8a7d-f39714f4d45f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.823959 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c4b4d8fa0e4e56b86e4939d4ad7428', 'request_id': 'req-ae443bd7-240d-4849-8a7d-f39714f4d45f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.842385 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] The token cache is being invalidate because project 45c4b4d8fa0e4e56b86e4939d4ad7428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:28.842749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.843530 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:28.845498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1311/2595] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:28 2022] DELETE /identity/v3/projects/45c4b4d8fa0e4e56b86e4939d4ad7428 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:32.191313 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c88bb-ad17-4d70-95f1-3a180c363166 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:32.204513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c88bb-ad17-4d70-95f1-3a180c363166 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:32.255589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03e20b-0880-4cf4-8507-c9c0b08c23a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:32.256263 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03e20b-0880-4cf4-8507-c9c0b08c23a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:32.256543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03e20b-0880-4cf4-8507-c9c0b08c23a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:32.256817 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b03e20b-0880-4cf4-8507-c9c0b08c23a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:32.258665 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-1b03e20b-0880-4cf4-8507-c9c0b08c23a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:32.319799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03e20b-0880-4cf4-8507-c9c0b08c23a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:32.321202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b03e20b-0880-4cf4-8507-c9c0b08c23a6 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:32.331072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1285/2596] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:35.609198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:35.610482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:35.626821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae443bd7-240d-4849-8a7d-f39714f4d45f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:35.633706 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:35.635157 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:35.635789 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:35.636564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] PATH_INFO: `/v3/users/94e69d561087490eb018178c3af5bc3e` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:35.638071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94e69d561087490eb018178c3af5bc3e)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:35.641310 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:35.697056 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94e69d561087490eb018178c3af5bc3e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:35.697879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94e69d561087490eb018178c3af5bc3e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:35.707322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94e69d561087490eb018178c3af5bc3e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:35.716307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94e69d561087490eb018178c3af5bc3e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:35.717013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4e7e7fbf-4380-49ac-9292-a403bbab731c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94e69d561087490eb018178c3af5bc3e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:35.740886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1312/2597] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:35 2022] DELETE /identity/v3/users/94e69d561087490eb018178c3af5bc3e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:35.921341 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03e20b-0880-4cf4-8507-c9c0b08c23a6 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:35.933695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b03e20b-0880-4cf4-8507-c9c0b08c23a6 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:35.989103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:35.996006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:35.996927 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:35.997206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:35.997583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] PATH_INFO: `/v3/projects/de72003d2e0e4a4395293a8281c3d2da` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:35.998890 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de72003d2e0e4a4395293a8281c3d2da)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:36.000827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:36.056413 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de72003d2e0e4a4395293a8281c3d2da', 'request_id': 'req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:36.065598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de72003d2e0e4a4395293a8281c3d2da', 'request_id': 'req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:36.075484 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de72003d2e0e4a4395293a8281c3d2da', 'request_id': 'req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:36.087679 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] The token cache is being invalidate because project de72003d2e0e4a4395293a8281c3d2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:36.087954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:36.088604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-55bdd0ea-859f-4d3c-ab53-d86e9af6a862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:36.090591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1286/2598] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:35 2022] DELETE /identity/v3/projects/de72003d2e0e4a4395293a8281c3d2da => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:36.095710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145733d1-d1a9-4cfa-97ef-eb9c16d4a12d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.096021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145733d1-d1a9-4cfa-97ef-eb9c16d4a12d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.096290 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145733d1-d1a9-4cfa-97ef-eb9c16d4a12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.114580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-145733d1-d1a9-4cfa-97ef-eb9c16d4a12d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:36.115772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-145733d1-d1a9-4cfa-97ef-eb9c16d4a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:36.136623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:36.178121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1313/2599] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:36:36.186169 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0299-d5fe-4b47-9304-bbcd90dc0c24 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.186458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0299-d5fe-4b47-9304-bbcd90dc0c24 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.186736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0299-d5fe-4b47-9304-bbcd90dc0c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.206282 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-de3d0299-d5fe-4b47-9304-bbcd90dc0c24 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:36.207513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-de3d0299-d5fe-4b47-9304-bbcd90dc0c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:36.217845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1287/2600] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:36.222710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145733d1-d1a9-4cfa-97ef-eb9c16d4a12d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:36.238429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145733d1-d1a9-4cfa-97ef-eb9c16d4a12d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:36.246688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f27f6-0d17-4575-8fa9-473af8abfd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:36.247595 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f27f6-0d17-4575-8fa9-473af8abfd66 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.247877 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f27f6-0d17-4575-8fa9-473af8abfd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.248169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f27f6-0d17-4575-8fa9-473af8abfd66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.249193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f27f6-0d17-4575-8fa9-473af8abfd66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:36:36.249512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f27f6-0d17-4575-8fa9-473af8abfd66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:36.251762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f27f6-0d17-4575-8fa9-473af8abfd66 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:36.264420 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1314/2601] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:36:36.268809 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d0299-d5fe-4b47-9304-bbcd90dc0c24 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:36.278799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d0299-d5fe-4b47-9304-bbcd90dc0c24 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:36.284789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a18f07-2a67-47fc-8904-3519d6f9db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:36.285495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a18f07-2a67-47fc-8904-3519d6f9db1c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.285776 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a18f07-2a67-47fc-8904-3519d6f9db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.286050 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a18f07-2a67-47fc-8904-3519d6f9db1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.286748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a18f07-2a67-47fc-8904-3519d6f9db1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:36.288693 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a18f07-2a67-47fc-8904-3519d6f9db1c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:36.335863 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1288/2602] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:36 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:36.341021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f27f6-0d17-4575-8fa9-473af8abfd66 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:36.352475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f27f6-0d17-4575-8fa9-473af8abfd66 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:36.421636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799447a-96a8-49ca-85a0-11c2040db193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:36.422315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799447a-96a8-49ca-85a0-11c2040db193 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.422600 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799447a-96a8-49ca-85a0-11c2040db193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.422887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799447a-96a8-49ca-85a0-11c2040db193 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.423588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799447a-96a8-49ca-85a0-11c2040db193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:36.425625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5799447a-96a8-49ca-85a0-11c2040db193 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:36.448133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1315/2603] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:36 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:36.452458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a18f07-2a67-47fc-8904-3519d6f9db1c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:36.463985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a18f07-2a67-47fc-8904-3519d6f9db1c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:36.469471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00348bbf-fd0e-4de4-b21b-c41af5c96552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:36.470151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00348bbf-fd0e-4de4-b21b-c41af5c96552 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.470437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00348bbf-fd0e-4de4-b21b-c41af5c96552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.470711 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00348bbf-fd0e-4de4-b21b-c41af5c96552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.471493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00348bbf-fd0e-4de4-b21b-c41af5c96552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:36.473157 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00348bbf-fd0e-4de4-b21b-c41af5c96552 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:36.483755 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1289/2604] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:36.487978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799447a-96a8-49ca-85a0-11c2040db193 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:36.498047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799447a-96a8-49ca-85a0-11c2040db193 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:36.503102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcef1f-c1c2-4855-bb7d-314951741572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:36.503767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcef1f-c1c2-4855-bb7d-314951741572 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.504074 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcef1f-c1c2-4855-bb7d-314951741572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.504325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcef1f-c1c2-4855-bb7d-314951741572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.505092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcef1f-c1c2-4855-bb7d-314951741572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:36.506712 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcef1f-c1c2-4855-bb7d-314951741572 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:36.516668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1316/2605] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:36.520801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00348bbf-fd0e-4de4-b21b-c41af5c96552 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:36.531149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00348bbf-fd0e-4de4-b21b-c41af5c96552 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:36.536032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17719f19-edf4-4fef-b521-35db69508193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:36.536955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17719f19-edf4-4fef-b521-35db69508193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.537241 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17719f19-edf4-4fef-b521-35db69508193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.537519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17719f19-edf4-4fef-b521-35db69508193 admin admin] PATH_INFO: `/v3/projects/cbeb1391f7ab4de5bf21c0904d082de4/users/0cf6852ab4cf4c80a11f9b2d72ab01d1/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.557977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17719f19-edf4-4fef-b521-35db69508193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbeb1391f7ab4de5bf21c0904d082de4, user_id=0cf6852ab4cf4c80a11f9b2d72ab01d1, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:36.560635 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17719f19-edf4-4fef-b521-35db69508193 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:36.575712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1290/2606] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:36 2022] PUT /identity/v3/projects/cbeb1391f7ab4de5bf21c0904d082de4/users/0cf6852ab4cf4c80a11f9b2d72ab01d1/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:36:36.582581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7a7f-6644-4632-9a04-48f2109ac513 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.582996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7a7f-6644-4632-9a04-48f2109ac513 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.583397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb7a7f-6644-4632-9a04-48f2109ac513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.613409 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9bfb7a7f-6644-4632-9a04-48f2109ac513 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:36.614550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9bfb7a7f-6644-4632-9a04-48f2109ac513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:36.677155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1317/2607] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:36.687007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17719f19-edf4-4fef-b521-35db69508193 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:36.688791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-17719f19-edf4-4fef-b521-35db69508193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:36.748396 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17719f19-edf4-4fef-b521-35db69508193 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:36.753122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29372414-cc15-47f2-97b9-67d05300f803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:36.753789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29372414-cc15-47f2-97b9-67d05300f803 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:36.754070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29372414-cc15-47f2-97b9-67d05300f803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:36.754345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29372414-cc15-47f2-97b9-67d05300f803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:36.764805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29372414-cc15-47f2-97b9-67d05300f803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:36.766300 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29372414-cc15-47f2-97b9-67d05300f803 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:36.777661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1291/2608] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:38.558122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb7a7f-6644-4632-9a04-48f2109ac513 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:38.559564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9bfb7a7f-6644-4632-9a04-48f2109ac513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:38.571816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb7a7f-6644-4632-9a04-48f2109ac513 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:38.576421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:38.577330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:38.577610 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:38.577880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] PATH_INFO: `/v3/users/1c2091b96cb242efbddbc41b643829d0` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:38.579065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2091b96cb242efbddbc41b643829d0)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:38.581132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:38.611106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:38.633590 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2091b96cb242efbddbc41b643829d0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:38.634342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2091b96cb242efbddbc41b643829d0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:38.641951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2091b96cb242efbddbc41b643829d0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:38.649569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2091b96cb242efbddbc41b643829d0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:38.650473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2091b96cb242efbddbc41b643829d0'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:38.670031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1318/2609] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:38 2022] DELETE /identity/v3/users/1c2091b96cb242efbddbc41b643829d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:36:38.675118 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9648b-f39e-4ed8-b3f2-a091cadf9c03 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:38.676062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9648b-f39e-4ed8-b3f2-a091cadf9c03 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:38.676343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9648b-f39e-4ed8-b3f2-a091cadf9c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:38.694672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6ea9648b-f39e-4ed8-b3f2-a091cadf9c03 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:38.695934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6ea9648b-f39e-4ed8-b3f2-a091cadf9c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:38.709995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:38.769437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1292/2610] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:38.780073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:38.781596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:38.847227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac109a4-09e1-458e-89b8-f284167f7846 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:38.851593 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06d5df-4030-4df3-b7aa-ea8db7f276f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:38.852251 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06d5df-4030-4df3-b7aa-ea8db7f276f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:38.852529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06d5df-4030-4df3-b7aa-ea8db7f276f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:38.852799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06d5df-4030-4df3-b7aa-ea8db7f276f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:38.862609 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06d5df-4030-4df3-b7aa-ea8db7f276f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:38.864272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06d5df-4030-4df3-b7aa-ea8db7f276f7 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:38.875623 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1319/2611] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:39.287541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9648b-f39e-4ed8-b3f2-a091cadf9c03 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:39.289752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6ea9648b-f39e-4ed8-b3f2-a091cadf9c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:39.309311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9648b-f39e-4ed8-b3f2-a091cadf9c03 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:39.315184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:39.316242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:39.316642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:39.317089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] PATH_INFO: `/v3/projects/2f041236bc10419dadb06ad049284960` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:39.320477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f041236bc10419dadb06ad049284960)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:39.325028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:39.396420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f041236bc10419dadb06ad049284960', 'request_id': 'req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.408245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f041236bc10419dadb06ad049284960', 'request_id': 'req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.419750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f041236bc10419dadb06ad049284960', 'request_id': 'req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.433977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] The token cache is being invalidate because project 2f041236bc10419dadb06ad049284960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:39.434343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.435092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.440914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1293/2612] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:39 2022] DELETE /identity/v3/projects/2f041236bc10419dadb06ad049284960 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:39.441328 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06d5df-4030-4df3-b7aa-ea8db7f276f7 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:39.455260 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06d5df-4030-4df3-b7aa-ea8db7f276f7 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:39.529659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:39.531715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:39.532006 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:39.532403 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] PATH_INFO: `/v3/users/d41ee4c574ec4ac3bebfe9a1ac5d4060` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:39.534145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41ee4c574ec4ac3bebfe9a1ac5d4060)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:39.536900 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:39.595995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41ee4c574ec4ac3bebfe9a1ac5d4060'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.597145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41ee4c574ec4ac3bebfe9a1ac5d4060'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.599080 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:39.609256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41ee4c574ec4ac3bebfe9a1ac5d4060'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.624248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41ee4c574ec4ac3bebfe9a1ac5d4060'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.625909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-8e3543f4-40ce-4b85-b065-9853e3f77ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41ee4c574ec4ac3bebfe9a1ac5d4060'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:39.651730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1320/2613] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:39 2022] DELETE /identity/v3/users/d41ee4c574ec4ac3bebfe9a1ac5d4060 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:39.972683 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:39.974455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:39.991716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af0dc3-6697-4e0a-b5a9-477aae7e97ac admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:40.077344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:40.078246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.078533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.078805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] PATH_INFO: `/v3/projects/32250764869d4270a721cb76f90f0b6e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.080012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=32250764869d4270a721cb76f90f0b6e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:40.082057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:40.134483 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:40.138860 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32250764869d4270a721cb76f90f0b6e', 'request_id': 'req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:40.145823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32250764869d4270a721cb76f90f0b6e', 'request_id': 'req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:40.157504 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32250764869d4270a721cb76f90f0b6e', 'request_id': 'req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:40.177684 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] The token cache is being invalidate because project 32250764869d4270a721cb76f90f0b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:40.178033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:40.179561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c8ad3c5f-39a0-46ed-9b38-6768f1ee3fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:40.184081 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1294/2614] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:39 2022] DELETE /identity/v3/projects/32250764869d4270a721cb76f90f0b6e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:40.189380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef56c-71fd-4426-aadf-47c4ff8741c1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.189678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef56c-71fd-4426-aadf-47c4ff8741c1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.190108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef56c-71fd-4426-aadf-47c4ff8741c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.215521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-52fef56c-71fd-4426-aadf-47c4ff8741c1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:40.216815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-52fef56c-71fd-4426-aadf-47c4ff8741c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:40.305421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1321/2615] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:40.307105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a5226-a853-403d-98c7-d08dafe97c96 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.307393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a5226-a853-403d-98c7-d08dafe97c96 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.307667 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a5226-a853-403d-98c7-d08dafe97c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.337794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d98a5226-a853-403d-98c7-d08dafe97c96 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:40.339394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d98a5226-a853-403d-98c7-d08dafe97c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:40.351061 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1295/2616] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:40.355171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fef56c-71fd-4426-aadf-47c4ff8741c1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:40.366544 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fef56c-71fd-4426-aadf-47c4ff8741c1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:40.375419 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032fe4d-b74e-47da-b588-367a46baac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:40.377136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032fe4d-b74e-47da-b588-367a46baac93 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.377859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032fe4d-b74e-47da-b588-367a46baac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.378752 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032fe4d-b74e-47da-b588-367a46baac93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.380445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032fe4d-b74e-47da-b588-367a46baac93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:36:40.380931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032fe4d-b74e-47da-b588-367a46baac93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:40.383042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032fe4d-b74e-47da-b588-367a46baac93 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:40.401172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1322/2617] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:36:40.403263 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a5226-a853-403d-98c7-d08dafe97c96 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:40.415865 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a5226-a853-403d-98c7-d08dafe97c96 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:40.422808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47492-fb7a-4baf-8927-b76994b9cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:40.428101 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47492-fb7a-4baf-8927-b76994b9cca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.429229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47492-fb7a-4baf-8927-b76994b9cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.430897 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a47492-fb7a-4baf-8927-b76994b9cca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.431946 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47492-fb7a-4baf-8927-b76994b9cca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:40.436029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a47492-fb7a-4baf-8927-b76994b9cca6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:40.478461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1296/2618] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:40 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:36:40.482841 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032fe4d-b74e-47da-b588-367a46baac93 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:40.493321 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032fe4d-b74e-47da-b588-367a46baac93 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:40.552671 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8f2b-1a4e-4a3e-8bb3-81034945cd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:40.553942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8f2b-1a4e-4a3e-8bb3-81034945cd9e admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.553942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8f2b-1a4e-4a3e-8bb3-81034945cd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.553942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa8f2b-1a4e-4a3e-8bb3-81034945cd9e admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.554647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa8f2b-1a4e-4a3e-8bb3-81034945cd9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:40.556901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa8f2b-1a4e-4a3e-8bb3-81034945cd9e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:40.578887 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1323/2619] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:40 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:36:40.582801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47492-fb7a-4baf-8927-b76994b9cca6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:40.593801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a47492-fb7a-4baf-8927-b76994b9cca6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:40.599183 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478447b2-3b60-45b0-b9d0-d276fae7a419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:40.599968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478447b2-3b60-45b0-b9d0-d276fae7a419 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.600280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478447b2-3b60-45b0-b9d0-d276fae7a419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.600623 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478447b2-3b60-45b0-b9d0-d276fae7a419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.601472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478447b2-3b60-45b0-b9d0-d276fae7a419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:40.603545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478447b2-3b60-45b0-b9d0-d276fae7a419 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:40.619547 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1297/2620] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:40.620737 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8f2b-1a4e-4a3e-8bb3-81034945cd9e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:40.633424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa8f2b-1a4e-4a3e-8bb3-81034945cd9e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:40.639523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c2c52-5ac8-4590-9d19-86bdadf03b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:40.640274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c2c52-5ac8-4590-9d19-86bdadf03b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.640928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c2c52-5ac8-4590-9d19-86bdadf03b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.641434 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c2c52-5ac8-4590-9d19-86bdadf03b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.642364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c2c52-5ac8-4590-9d19-86bdadf03b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:40.644225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157c2c52-5ac8-4590-9d19-86bdadf03b9a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:40.659299 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1324/2621] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:40.660883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478447b2-3b60-45b0-b9d0-d276fae7a419 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:40.674181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478447b2-3b60-45b0-b9d0-d276fae7a419 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:40.686746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09706f9-a318-430b-a29b-452218ef7369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:40.687713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09706f9-a318-430b-a29b-452218ef7369 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.687993 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09706f9-a318-430b-a29b-452218ef7369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.688317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09706f9-a318-430b-a29b-452218ef7369 admin admin] PATH_INFO: `/v3/projects/fd7f01c69bfd43d8a1075515eb02fe52/users/2edc261d30af48c9b838dfe24f6113a0/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.705002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09706f9-a318-430b-a29b-452218ef7369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7f01c69bfd43d8a1075515eb02fe52, user_id=2edc261d30af48c9b838dfe24f6113a0, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:40.707596 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09706f9-a318-430b-a29b-452218ef7369 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:40.728508 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1298/2622] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:40 2022] PUT /identity/v3/projects/fd7f01c69bfd43d8a1075515eb02fe52/users/2edc261d30af48c9b838dfe24f6113a0/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:40.734262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c37d-d0c3-429f-9abf-81307e0a0438 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.735439 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c37d-d0c3-429f-9abf-81307e0a0438 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.735722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c37d-d0c3-429f-9abf-81307e0a0438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.772957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-54f9c37d-d0c3-429f-9abf-81307e0a0438 None None] MFA Rules not processed for user `2edc261d30af48c9b838dfe24f6113a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:40.774526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-54f9c37d-d0c3-429f-9abf-81307e0a0438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:40.798001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:40.865123 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1325/2623] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:40.869279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09706f9-a318-430b-a29b-452218ef7369 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:40.947331 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09706f9-a318-430b-a29b-452218ef7369 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:40.953899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71f1e5-08cc-4854-8441-8f8bb8b4d0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:40.954231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f1e5-08cc-4854-8441-8f8bb8b4d0ce admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:40.954643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f1e5-08cc-4854-8441-8f8bb8b4d0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:40.954924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f1e5-08cc-4854-8441-8f8bb8b4d0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:40.956052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71f1e5-08cc-4854-8441-8f8bb8b4d0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:40.958209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71f1e5-08cc-4854-8441-8f8bb8b4d0ce admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:40.992740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1299/2624] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:40 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:36:40.996766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9c37d-d0c3-429f-9abf-81307e0a0438 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:41.009495 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9c37d-d0c3-429f-9abf-81307e0a0438 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:41.062915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c560dc-34bc-4791-b712-7e2351a86384 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:41.063211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c560dc-34bc-4791-b712-7e2351a86384 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:41.063577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c560dc-34bc-4791-b712-7e2351a86384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:41.087192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6af8-e4e3-415f-9ca8-5526e8d98002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:41.087961 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6af8-e4e3-415f-9ca8-5526e8d98002 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:41.088405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6af8-e4e3-415f-9ca8-5526e8d98002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:41.088694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6af8-e4e3-415f-9ca8-5526e8d98002 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:41.089513 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d6af8-e4e3-415f-9ca8-5526e8d98002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:41.091465 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d6af8-e4e3-415f-9ca8-5526e8d98002 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:41.108563 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a7c560dc-34bc-4791-b712-7e2351a86384 None None] MFA Rules not processed for user `0cf6852ab4cf4c80a11f9b2d72ab01d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:41.110852 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a7c560dc-34bc-4791-b712-7e2351a86384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:41.118050 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1326/2625] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:40 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:41.122000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6af8-e4e3-415f-9ca8-5526e8d98002 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:41.133175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6af8-e4e3-415f-9ca8-5526e8d98002 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:41.138116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc317b3-9df1-4eae-8e23-d4166ab3d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:41.138872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc317b3-9df1-4eae-8e23-d4166ab3d91e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:41.139260 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc317b3-9df1-4eae-8e23-d4166ab3d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:41.139730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc317b3-9df1-4eae-8e23-d4166ab3d91e admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:41.140543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc317b3-9df1-4eae-8e23-d4166ab3d91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:41.142326 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc317b3-9df1-4eae-8e23-d4166ab3d91e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:41.157979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1327/2626] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:36:41.163392 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc317b3-9df1-4eae-8e23-d4166ab3d91e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:41.173935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc317b3-9df1-4eae-8e23-d4166ab3d91e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:41.179849 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c6385-4bd0-49c8-b31c-9be17f38da78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:41.180627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:41.181089 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c6385-4bd0-49c8-b31c-9be17f38da78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:41.181467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c6385-4bd0-49c8-b31c-9be17f38da78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:41.181845 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c6385-4bd0-49c8-b31c-9be17f38da78 admin admin] PATH_INFO: `/v3/projects/7ca01b4b0a1f44e597bcbc9f0fdc4f1d/users/785e9668340647daa76b28b0db14dc11/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:41.202330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c6385-4bd0-49c8-b31c-9be17f38da78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca01b4b0a1f44e597bcbc9f0fdc4f1d, user_id=785e9668340647daa76b28b0db14dc11, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:41.206239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c6385-4bd0-49c8-b31c-9be17f38da78 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:41.213593 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1300/2627] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:41.228559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c560dc-34bc-4791-b712-7e2351a86384 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:41.238576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a7c560dc-34bc-4791-b712-7e2351a86384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:41.245781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1328/2628] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:41 2022] PUT /identity/v3/projects/7ca01b4b0a1f44e597bcbc9f0fdc4f1d/users/785e9668340647daa76b28b0db14dc11/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:41.259647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c6385-4bd0-49c8-b31c-9be17f38da78 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:41.342347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c6385-4bd0-49c8-b31c-9be17f38da78 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:41.347395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1865c-99bd-467a-b738-5bbef1c8fb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:41.348086 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1865c-99bd-467a-b738-5bbef1c8fb66 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:41.348368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1865c-99bd-467a-b738-5bbef1c8fb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:41.348643 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1865c-99bd-467a-b738-5bbef1c8fb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:41.349546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1865c-99bd-467a-b738-5bbef1c8fb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:41.351444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1865c-99bd-467a-b738-5bbef1c8fb66 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:41.362057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1329/2629] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:41.366524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1865c-99bd-467a-b738-5bbef1c8fb66 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:41.369312 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c560dc-34bc-4791-b712-7e2351a86384 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:41.377751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1865c-99bd-467a-b738-5bbef1c8fb66 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:41.384603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bcc6c-6308-4142-b987-f1b2794ec548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:41.385484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bcc6c-6308-4142-b987-f1b2794ec548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:41.385909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bcc6c-6308-4142-b987-f1b2794ec548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:41.386204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bcc6c-6308-4142-b987-f1b2794ec548 admin admin] PATH_INFO: `/v3/projects/7ca01b4b0a1f44e597bcbc9f0fdc4f1d/users/785e9668340647daa76b28b0db14dc11/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:41.388201 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bcc6c-6308-4142-b987-f1b2794ec548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca01b4b0a1f44e597bcbc9f0fdc4f1d, user_id=785e9668340647daa76b28b0db14dc11, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:41.390922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bcc6c-6308-4142-b987-f1b2794ec548 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:41.397551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:41.403989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1330/2630] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:41 2022] PUT /identity/v3/projects/7ca01b4b0a1f44e597bcbc9f0fdc4f1d/users/785e9668340647daa76b28b0db14dc11/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:41.415257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb7db-1a90-4ba3-9833-a014afcf041f None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:41.415551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb7db-1a90-4ba3-9833-a014afcf041f None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:41.415829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bb7db-1a90-4ba3-9833-a014afcf041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:41.444558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-cc5bb7db-1a90-4ba3-9833-a014afcf041f None None] MFA Rules not processed for user `785e9668340647daa76b28b0db14dc11`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:41.445880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-cc5bb7db-1a90-4ba3-9833-a014afcf041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:41.451519 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5924d7-6b29-401b-b02c-2930a153fd83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:41.452193 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5924d7-6b29-401b-b02c-2930a153fd83 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:41.452473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5924d7-6b29-401b-b02c-2930a153fd83 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:41.452747 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5924d7-6b29-401b-b02c-2930a153fd83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:41.518476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5924d7-6b29-401b-b02c-2930a153fd83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:41.520377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5924d7-6b29-401b-b02c-2930a153fd83 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:41.530185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1301/2631] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:41.531174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1331/2632] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:36:41.544115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5924d7-6b29-401b-b02c-2930a153fd83 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:41.545745 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8f5924d7-6b29-401b-b02c-2930a153fd83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:41.567845 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:41.616005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5924d7-6b29-401b-b02c-2930a153fd83 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:41.680260 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1db0f-e3ec-490c-ae78-8209b8671c84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:41.681267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1db0f-e3ec-490c-ae78-8209b8671c84 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:41.681726 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1db0f-e3ec-490c-ae78-8209b8671c84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:41.682333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1db0f-e3ec-490c-ae78-8209b8671c84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:41.783200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1db0f-e3ec-490c-ae78-8209b8671c84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:41.784956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1db0f-e3ec-490c-ae78-8209b8671c84 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:41.797477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1302/2633] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:42.934243 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83389d-cc71-414c-8293-fcd10f00524c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:42.934748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83389d-cc71-414c-8293-fcd10f00524c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:42.934846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83389d-cc71-414c-8293-fcd10f00524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:42.952744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1e83389d-cc71-414c-8293-fcd10f00524c None None] MFA Rules not processed for user `0cf6852ab4cf4c80a11f9b2d72ab01d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:42.953979 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1e83389d-cc71-414c-8293-fcd10f00524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:43.012770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1332/2634] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:43.238760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1db0f-e3ec-490c-ae78-8209b8671c84 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:43.241242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f6d1db0f-e3ec-490c-ae78-8209b8671c84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:43.256139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1db0f-e3ec-490c-ae78-8209b8671c84 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:43.261293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce7b13-14a3-45b1-b66c-bb39575d87fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:43.262008 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce7b13-14a3-45b1-b66c-bb39575d87fa service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:43.262248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce7b13-14a3-45b1-b66c-bb39575d87fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:43.262528 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce7b13-14a3-45b1-b66c-bb39575d87fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:43.281987 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce7b13-14a3-45b1-b66c-bb39575d87fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:43.284704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce7b13-14a3-45b1-b66c-bb39575d87fa service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:43.301468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1303/2635] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:43.374288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83389d-cc71-414c-8293-fcd10f00524c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:43.375763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1e83389d-cc71-414c-8293-fcd10f00524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:43.466914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83389d-cc71-414c-8293-fcd10f00524c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:43.470782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade5312-5e49-4927-904b-135dc2e10fb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:43.471498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade5312-5e49-4927-904b-135dc2e10fb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:43.476984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade5312-5e49-4927-904b-135dc2e10fb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:43.476984 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade5312-5e49-4927-904b-135dc2e10fb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:43.478501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7ade5312-5e49-4927-904b-135dc2e10fb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:43.489751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade5312-5e49-4927-904b-135dc2e10fb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:43.491408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade5312-5e49-4927-904b-135dc2e10fb7 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:43.500359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1333/2636] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:47.138732 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce7b13-14a3-45b1-b66c-bb39575d87fa service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:47.203161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce7b13-14a3-45b1-b66c-bb39575d87fa service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:47.207774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:47.208659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:47.208975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:47.209250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] PATH_INFO: `/v3/users/2edc261d30af48c9b838dfe24f6113a0` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:47.210518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2edc261d30af48c9b838dfe24f6113a0)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:47.212832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:47.228955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:47.266365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2edc261d30af48c9b838dfe24f6113a0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.267036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2edc261d30af48c9b838dfe24f6113a0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.267647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2edc261d30af48c9b838dfe24f6113a0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.280689 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2edc261d30af48c9b838dfe24f6113a0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.287905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2edc261d30af48c9b838dfe24f6113a0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.302599 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1304/2637] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:47 2022] DELETE /identity/v3/users/2edc261d30af48c9b838dfe24f6113a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:47.307262 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcf887-45db-48b0-8332-0eb011de6e71 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:47.307788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcf887-45db-48b0-8332-0eb011de6e71 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:47.307894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcf887-45db-48b0-8332-0eb011de6e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:47.325601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-c8fcf887-45db-48b0-8332-0eb011de6e71 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:47.326855 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c8fcf887-45db-48b0-8332-0eb011de6e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:47.359214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=100 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:47.395132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1334/2638] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:36:47.405870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:47.407439 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:47.468243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719f134-eef8-4bf9-8c81-9e378fe2c467 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:47.472068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672faa-4bf8-4cbc-bcdc-a4b118110173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:47.472837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672faa-4bf8-4cbc-bcdc-a4b118110173 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:47.473609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672faa-4bf8-4cbc-bcdc-a4b118110173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:47.473888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672faa-4bf8-4cbc-bcdc-a4b118110173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:47.483507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d672faa-4bf8-4cbc-bcdc-a4b118110173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:47.485003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d672faa-4bf8-4cbc-bcdc-a4b118110173 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:47.494610 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1305/2639] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:47.776152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcf887-45db-48b0-8332-0eb011de6e71 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:47.777753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c8fcf887-45db-48b0-8332-0eb011de6e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:47.789635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcf887-45db-48b0-8332-0eb011de6e71 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:47.794271 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:47.795151 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:47.795424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:47.795697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] PATH_INFO: `/v3/projects/fd7f01c69bfd43d8a1075515eb02fe52` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:47.796893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7f01c69bfd43d8a1075515eb02fe52)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:47.798799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:47.848258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7f01c69bfd43d8a1075515eb02fe52', 'request_id': 'req-3d05bc98-197d-4630-884c-0b6dd90f96eb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.853777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7f01c69bfd43d8a1075515eb02fe52', 'request_id': 'req-3d05bc98-197d-4630-884c-0b6dd90f96eb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.862960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7f01c69bfd43d8a1075515eb02fe52', 'request_id': 'req-3d05bc98-197d-4630-884c-0b6dd90f96eb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.874382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] The token cache is being invalidate because project fd7f01c69bfd43d8a1075515eb02fe52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:47.874668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.875288 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:47.876910 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1335/2640] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:47 2022] DELETE /identity/v3/projects/fd7f01c69bfd43d8a1075515eb02fe52 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:47.881032 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672faa-4bf8-4cbc-bcdc-a4b118110173 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:47.890725 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672faa-4bf8-4cbc-bcdc-a4b118110173 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:47.948802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:47.949702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:47.950001 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:47.950254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] PATH_INFO: `/v3/users/785e9668340647daa76b28b0db14dc11` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:47.951492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=785e9668340647daa76b28b0db14dc11)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:47.953468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:47.996634 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:48.003636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785e9668340647daa76b28b0db14dc11'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.004587 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785e9668340647daa76b28b0db14dc11'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.005615 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785e9668340647daa76b28b0db14dc11'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.018778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785e9668340647daa76b28b0db14dc11'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.025757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f3987d86-ebb6-4939-93ca-ffc82e7da091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785e9668340647daa76b28b0db14dc11'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.041932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1306/2641] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:47 2022] DELETE /identity/v3/users/785e9668340647daa76b28b0db14dc11 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:48.449851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:48.451457 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:48.465905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05bc98-197d-4630-884c-0b6dd90f96eb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:48.559520 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:48.560395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:48.560675 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:48.561016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] PATH_INFO: `/v3/projects/7ca01b4b0a1f44e597bcbc9f0fdc4f1d` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:48.562239 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca01b4b0a1f44e597bcbc9f0fdc4f1d)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:48.564192 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:48.612940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca01b4b0a1f44e597bcbc9f0fdc4f1d', 'request_id': 'req-104830f6-a63d-48f2-b5c2-30765bd8efc6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.617744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:48.619065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca01b4b0a1f44e597bcbc9f0fdc4f1d', 'request_id': 'req-104830f6-a63d-48f2-b5c2-30765bd8efc6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.628651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca01b4b0a1f44e597bcbc9f0fdc4f1d', 'request_id': 'req-104830f6-a63d-48f2-b5c2-30765bd8efc6'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.642929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] The token cache is being invalidate because project 7ca01b4b0a1f44e597bcbc9f0fdc4f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:48.643480 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.644550 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-104830f6-a63d-48f2-b5c2-30765bd8efc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:48.646276 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1336/2642] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:48 2022] DELETE /identity/v3/projects/7ca01b4b0a1f44e597bcbc9f0fdc4f1d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:48.651162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aedf9-7b4c-4222-afc5-f509bddf09ba None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:48.651632 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aedf9-7b4c-4222-afc5-f509bddf09ba None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:48.651743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aedf9-7b4c-4222-afc5-f509bddf09ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:48.670496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-694aedf9-7b4c-4222-afc5-f509bddf09ba None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:48.671954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-694aedf9-7b4c-4222-afc5-f509bddf09ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:48.736986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1307/2643] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:48.747779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e51950-b6a1-41d3-bc78-9d8222947941 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:48.747779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e51950-b6a1-41d3-bc78-9d8222947941 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:48.748062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e51950-b6a1-41d3-bc78-9d8222947941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:48.777653 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-e7e51950-b6a1-41d3-bc78-9d8222947941 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:48.778890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e7e51950-b6a1-41d3-bc78-9d8222947941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:48.787510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1337/2644] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:48.792105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aedf9-7b4c-4222-afc5-f509bddf09ba None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:48.802748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aedf9-7b4c-4222-afc5-f509bddf09ba None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:48.808493 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78281868-948d-4b72-a48a-955ebdc51957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:48.809190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78281868-948d-4b72-a48a-955ebdc51957 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:48.809458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78281868-948d-4b72-a48a-955ebdc51957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:48.809722 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78281868-948d-4b72-a48a-955ebdc51957 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:48.810453 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78281868-948d-4b72-a48a-955ebdc51957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:36:48.810754 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78281868-948d-4b72-a48a-955ebdc51957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:48.812371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78281868-948d-4b72-a48a-955ebdc51957 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:48.824643 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1308/2645] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:36:48.828997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e51950-b6a1-41d3-bc78-9d8222947941 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:48.838787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e51950-b6a1-41d3-bc78-9d8222947941 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:48.843812 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a227920-2cea-411b-815d-f19a5fd1b8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:48.844460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a227920-2cea-411b-815d-f19a5fd1b8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:48.844747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a227920-2cea-411b-815d-f19a5fd1b8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:48.845057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a227920-2cea-411b-815d-f19a5fd1b8b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:48.845972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a227920-2cea-411b-815d-f19a5fd1b8b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:48.847914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a227920-2cea-411b-815d-f19a5fd1b8b1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:48.875815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1338/2646] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:48 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:48.880059 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78281868-948d-4b72-a48a-955ebdc51957 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:48.890167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78281868-948d-4b72-a48a-955ebdc51957 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:48.947588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7b079-29aa-4124-92cd-885b4c3e2722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:48.948266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7b079-29aa-4124-92cd-885b4c3e2722 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:48.948549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7b079-29aa-4124-92cd-885b4c3e2722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:48.948825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7b079-29aa-4124-92cd-885b4c3e2722 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:48.949548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7b079-29aa-4124-92cd-885b4c3e2722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:48.951527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7b079-29aa-4124-92cd-885b4c3e2722 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:48.975435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1309/2647] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:48 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:48.979754 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a227920-2cea-411b-815d-f19a5fd1b8b1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:48.990990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a227920-2cea-411b-815d-f19a5fd1b8b1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:48.996879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656cca4-4c55-46cc-b536-955029a0b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:48.997581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656cca4-4c55-46cc-b536-955029a0b586 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:48.997859 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656cca4-4c55-46cc-b536-955029a0b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:48.998129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656cca4-4c55-46cc-b536-955029a0b586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:48.998899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656cca4-4c55-46cc-b536-955029a0b586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.000519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656cca4-4c55-46cc-b536-955029a0b586 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.013512 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1339/2648] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:49.017759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7b079-29aa-4124-92cd-885b4c3e2722 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:49.028883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7b079-29aa-4124-92cd-885b4c3e2722 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:49.034650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdfbea-8f20-48d6-8297-01692011147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:49.035318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdfbea-8f20-48d6-8297-01692011147d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.035597 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdfbea-8f20-48d6-8297-01692011147d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.035875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdfbea-8f20-48d6-8297-01692011147d admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.036603 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdfbea-8f20-48d6-8297-01692011147d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.038367 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdfbea-8f20-48d6-8297-01692011147d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.048630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1310/2649] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:49.052879 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656cca4-4c55-46cc-b536-955029a0b586 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:49.063503 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656cca4-4c55-46cc-b536-955029a0b586 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:49.068631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9c02-026d-486c-a786-bba5884cb9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:49.069556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9c02-026d-486c-a786-bba5884cb9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.069833 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9c02-026d-486c-a786-bba5884cb9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.070109 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b9c02-026d-486c-a786-bba5884cb9d4 admin admin] PATH_INFO: `/v3/projects/ffbc9cddcaa14674bd78a1c104af2fb3/users/20ea3696226b4b7b9dba361e864aefe4/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.085791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9c02-026d-486c-a786-bba5884cb9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbc9cddcaa14674bd78a1c104af2fb3, user_id=20ea3696226b4b7b9dba361e864aefe4, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.088870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b9c02-026d-486c-a786-bba5884cb9d4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.108397 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1340/2650] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:49 2022] PUT /identity/v3/projects/ffbc9cddcaa14674bd78a1c104af2fb3/users/20ea3696226b4b7b9dba361e864aefe4/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:49.121049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760ea5-3251-41f8-a2d9-e08b523b6cf2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.121414 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760ea5-3251-41f8-a2d9-e08b523b6cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.121785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760ea5-3251-41f8-a2d9-e08b523b6cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.151859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-31760ea5-3251-41f8-a2d9-e08b523b6cf2 None None] MFA Rules not processed for user `20ea3696226b4b7b9dba361e864aefe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:49.153154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-31760ea5-3251-41f8-a2d9-e08b523b6cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:49.163051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:49.222808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1311/2651] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:49.227787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9c02-026d-486c-a786-bba5884cb9d4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:49.292502 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b9c02-026d-486c-a786-bba5884cb9d4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:49.298236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abfffe-bf39-405a-982d-53fd42f86ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:49.298897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abfffe-bf39-405a-982d-53fd42f86ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.299179 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abfffe-bf39-405a-982d-53fd42f86ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.299494 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abfffe-bf39-405a-982d-53fd42f86ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.300184 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abfffe-bf39-405a-982d-53fd42f86ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.302211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abfffe-bf39-405a-982d-53fd42f86ea4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.330915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1341/2652] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:49 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:49.335067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31760ea5-3251-41f8-a2d9-e08b523b6cf2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:49.346781 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31760ea5-3251-41f8-a2d9-e08b523b6cf2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:49.417609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8272f77-b44a-47b8-aae6-05f85d1137c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:49.418288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8272f77-b44a-47b8-aae6-05f85d1137c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.418574 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8272f77-b44a-47b8-aae6-05f85d1137c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.418823 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8272f77-b44a-47b8-aae6-05f85d1137c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.419512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8272f77-b44a-47b8-aae6-05f85d1137c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.421538 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8272f77-b44a-47b8-aae6-05f85d1137c3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.451867 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1312/2653] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:49 2022] POST /identity/v3/users => generated 301 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:49.457592 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abfffe-bf39-405a-982d-53fd42f86ea4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:49.468625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abfffe-bf39-405a-982d-53fd42f86ea4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:49.473785 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3514f-c2b0-4c59-b42f-b20041d138be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:49.474454 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3514f-c2b0-4c59-b42f-b20041d138be admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.474739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3514f-c2b0-4c59-b42f-b20041d138be admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.475013 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3514f-c2b0-4c59-b42f-b20041d138be admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.475746 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3514f-c2b0-4c59-b42f-b20041d138be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.477526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3514f-c2b0-4c59-b42f-b20041d138be admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.488216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1342/2654] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:49.492345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8272f77-b44a-47b8-aae6-05f85d1137c3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:49.502400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8272f77-b44a-47b8-aae6-05f85d1137c3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:49.507266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb05644-aa73-48c5-98fc-622b50b86490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:49.508162 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb05644-aa73-48c5-98fc-622b50b86490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.508442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb05644-aa73-48c5-98fc-622b50b86490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.508717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb05644-aa73-48c5-98fc-622b50b86490 admin admin] PATH_INFO: `/v3/projects/e0431554738141078c8d3d504def5704/users/443e33b284224589985ebce0e61674a1/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.523716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb05644-aa73-48c5-98fc-622b50b86490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0431554738141078c8d3d504def5704, user_id=443e33b284224589985ebce0e61674a1, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.526415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb05644-aa73-48c5-98fc-622b50b86490 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.541299 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1313/2655] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:49 2022] PUT /identity/v3/projects/e0431554738141078c8d3d504def5704/users/443e33b284224589985ebce0e61674a1/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:36:49.546010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3514f-c2b0-4c59-b42f-b20041d138be admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:49.557570 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3514f-c2b0-4c59-b42f-b20041d138be admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:49.608703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:49.617016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a0093-8306-4148-9fbe-09667eb90bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:49.617729 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0093-8306-4148-9fbe-09667eb90bfe admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.618018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0093-8306-4148-9fbe-09667eb90bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.618509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a0093-8306-4148-9fbe-09667eb90bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.619254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a0093-8306-4148-9fbe-09667eb90bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.621455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a0093-8306-4148-9fbe-09667eb90bfe admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.631916 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1343/2656] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:49.636347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb05644-aa73-48c5-98fc-622b50b86490 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:49.647044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb05644-aa73-48c5-98fc-622b50b86490 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:49.651866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b4c76-d1e0-4df3-b2f8-34a2fef32dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:49.652756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b4c76-d1e0-4df3-b2f8-34a2fef32dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.653069 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b4c76-d1e0-4df3-b2f8-34a2fef32dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.653342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b4c76-d1e0-4df3-b2f8-34a2fef32dbe admin admin] PATH_INFO: `/v3/projects/e0431554738141078c8d3d504def5704/users/443e33b284224589985ebce0e61674a1/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.655390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b4c76-d1e0-4df3-b2f8-34a2fef32dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0431554738141078c8d3d504def5704, user_id=443e33b284224589985ebce0e61674a1, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.658103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b4c76-d1e0-4df3-b2f8-34a2fef32dbe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.669184 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1314/2657] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:49 2022] PUT /identity/v3/projects/e0431554738141078c8d3d504def5704/users/443e33b284224589985ebce0e61674a1/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:49.679648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89361cb2-6831-44ce-af9c-d3282dc10e5c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.679957 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89361cb2-6831-44ce-af9c-d3282dc10e5c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.680237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89361cb2-6831-44ce-af9c-d3282dc10e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.707170 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-89361cb2-6831-44ce-af9c-d3282dc10e5c None None] MFA Rules not processed for user `443e33b284224589985ebce0e61674a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:49.708421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-89361cb2-6831-44ce-af9c-d3282dc10e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:49.796735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1344/2658] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:49.807928 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b4c76-d1e0-4df3-b2f8-34a2fef32dbe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:49.809672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b28b4c76-d1e0-4df3-b2f8-34a2fef32dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:49.872714 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b4c76-d1e0-4df3-b2f8-34a2fef32dbe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:49.876449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b06e1-1c76-42e8-a047-6cb52cdb81fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:49.877131 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b06e1-1c76-42e8-a047-6cb52cdb81fc service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:49.877439 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b06e1-1c76-42e8-a047-6cb52cdb81fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:49.877744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b06e1-1c76-42e8-a047-6cb52cdb81fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:49.886846 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b06e1-1c76-42e8-a047-6cb52cdb81fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:49.888301 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b06e1-1c76-42e8-a047-6cb52cdb81fc service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:49.898029 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1315/2659] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:50.026542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89361cb2-6831-44ce-af9c-d3282dc10e5c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:50.090577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89361cb2-6831-44ce-af9c-d3282dc10e5c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:50.095724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:50.096658 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:50.096982 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:50.097264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] PATH_INFO: `/v3/users/20ea3696226b4b7b9dba361e864aefe4` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:50.098489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ea3696226b4b7b9dba361e864aefe4)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:50.100450 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:50.149667 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ea3696226b4b7b9dba361e864aefe4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.150309 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ea3696226b4b7b9dba361e864aefe4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.158907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ea3696226b4b7b9dba361e864aefe4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.167333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ea3696226b4b7b9dba361e864aefe4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.168168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ea3696226b4b7b9dba361e864aefe4'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.179890 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:50.189190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1345/2660] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:50 2022] DELETE /identity/v3/users/20ea3696226b4b7b9dba361e864aefe4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:50.193619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afd712-15e2-4737-bdf7-b8e33fed4647 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:50.193905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afd712-15e2-4737-bdf7-b8e33fed4647 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:50.194175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afd712-15e2-4737-bdf7-b8e33fed4647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:50.208034 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:50.213386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-91afd712-15e2-4737-bdf7-b8e33fed4647 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:50.216377 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-91afd712-15e2-4737-bdf7-b8e33fed4647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:50.277881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1316/2661] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:50.288254 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:50.290062 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:50.354146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979f960-f561-4527-853c-8006dea070fb admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:50.358452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbed94-96d5-4609-8c20-dac3c0b5b832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:50.359110 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbed94-96d5-4609-8c20-dac3c0b5b832 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:50.359391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbed94-96d5-4609-8c20-dac3c0b5b832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:50.359761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbed94-96d5-4609-8c20-dac3c0b5b832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:50.371021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbed94-96d5-4609-8c20-dac3c0b5b832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:50.372634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbed94-96d5-4609-8c20-dac3c0b5b832 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:50.382988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1346/2662] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:36:50.659384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afd712-15e2-4737-bdf7-b8e33fed4647 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:50.660880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-91afd712-15e2-4737-bdf7-b8e33fed4647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:50.673449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afd712-15e2-4737-bdf7-b8e33fed4647 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:50.678953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:50.679866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:50.680135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:50.680408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] PATH_INFO: `/v3/projects/ffbc9cddcaa14674bd78a1c104af2fb3` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:50.681749 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbc9cddcaa14674bd78a1c104af2fb3)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:50.683753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:50.733898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbc9cddcaa14674bd78a1c104af2fb3', 'request_id': 'req-ea55a562-ca70-482e-935c-3ad0b8399e45'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.740231 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbc9cddcaa14674bd78a1c104af2fb3', 'request_id': 'req-ea55a562-ca70-482e-935c-3ad0b8399e45'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.749671 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbc9cddcaa14674bd78a1c104af2fb3', 'request_id': 'req-ea55a562-ca70-482e-935c-3ad0b8399e45'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.762031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] The token cache is being invalidate because project ffbc9cddcaa14674bd78a1c104af2fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:50.762349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.763076 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.764672 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1317/2663] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:50 2022] DELETE /identity/v3/projects/ffbc9cddcaa14674bd78a1c104af2fb3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:50.769640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbed94-96d5-4609-8c20-dac3c0b5b832 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:50.779221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbed94-96d5-4609-8c20-dac3c0b5b832 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:50.848722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:50.849682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:50.849967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:50.850244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] PATH_INFO: `/v3/users/443e33b284224589985ebce0e61674a1` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:50.852042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443e33b284224589985ebce0e61674a1)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:50.854719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:50.907039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443e33b284224589985ebce0e61674a1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.907739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443e33b284224589985ebce0e61674a1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.918266 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443e33b284224589985ebce0e61674a1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.925698 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443e33b284224589985ebce0e61674a1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.926322 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-fc4efb41-c76f-4b34-8f7a-7a7c10244b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443e33b284224589985ebce0e61674a1'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:50.947731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1347/2664] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:50 2022] DELETE /identity/v3/users/443e33b284224589985ebce0e61674a1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:36:51.227666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:51.229246 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:51.242657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55a562-ca70-482e-935c-3ad0b8399e45 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:51.300434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:51.301333 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.301619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.301896 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] PATH_INFO: `/v3/projects/e0431554738141078c8d3d504def5704` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.303110 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0431554738141078c8d3d504def5704)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:51.305234 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:51.341337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:51.355462 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0431554738141078c8d3d504def5704', 'request_id': 'req-537e55d2-06b0-44ef-8937-6563d399c3a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:51.361006 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0431554738141078c8d3d504def5704', 'request_id': 'req-537e55d2-06b0-44ef-8937-6563d399c3a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:51.370326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0431554738141078c8d3d504def5704', 'request_id': 'req-537e55d2-06b0-44ef-8937-6563d399c3a1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:51.383255 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] The token cache is being invalidate because project e0431554738141078c8d3d504def5704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:51.383545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:51.384258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-537e55d2-06b0-44ef-8937-6563d399c3a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:51.386306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1318/2665] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:51 2022] DELETE /identity/v3/projects/e0431554738141078c8d3d504def5704 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:51.392027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366cb2-de01-4c7b-b47d-94ee57983e47 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.392341 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366cb2-de01-4c7b-b47d-94ee57983e47 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.392622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b366cb2-de01-4c7b-b47d-94ee57983e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.414770 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-5b366cb2-de01-4c7b-b47d-94ee57983e47 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:51.415909 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5b366cb2-de01-4c7b-b47d-94ee57983e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:51.433373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:51.487248 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1348/2666] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:51.495349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cea5-204c-4d26-b8bc-17a3aa8f89c2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.495642 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cea5-204c-4d26-b8bc-17a3aa8f89c2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.495923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357cea5-204c-4d26-b8bc-17a3aa8f89c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.515871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2357cea5-204c-4d26-b8bc-17a3aa8f89c2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:51.517121 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2357cea5-204c-4d26-b8bc-17a3aa8f89c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:51.526720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1319/2667] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:51.531691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366cb2-de01-4c7b-b47d-94ee57983e47 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:51.547980 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b366cb2-de01-4c7b-b47d-94ee57983e47 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:51.554860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6c531-f6bd-4dd8-8157-fa85e8bb5c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:51.555523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6c531-f6bd-4dd8-8157-fa85e8bb5c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.555806 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6c531-f6bd-4dd8-8157-fa85e8bb5c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.556076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6c531-f6bd-4dd8-8157-fa85e8bb5c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.556808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6c531-f6bd-4dd8-8157-fa85e8bb5c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:36:51.557159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6c531-f6bd-4dd8-8157-fa85e8bb5c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:51.558968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6c531-f6bd-4dd8-8157-fa85e8bb5c6e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:51.571445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1349/2668] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:36:51.575901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357cea5-204c-4d26-b8bc-17a3aa8f89c2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:51.585885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357cea5-204c-4d26-b8bc-17a3aa8f89c2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:51.591295 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e3c44-278e-4b09-b8b2-5dc1e1eec0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:51.591955 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e3c44-278e-4b09-b8b2-5dc1e1eec0da admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.592237 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e3c44-278e-4b09-b8b2-5dc1e1eec0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.592509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e3c44-278e-4b09-b8b2-5dc1e1eec0da admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.593266 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e3c44-278e-4b09-b8b2-5dc1e1eec0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:51.595208 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e3c44-278e-4b09-b8b2-5dc1e1eec0da admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:51.623153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1320/2669] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:51 2022] POST /identity/v3/projects => generated 409 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:51.627567 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6c531-f6bd-4dd8-8157-fa85e8bb5c6e admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:51.638395 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6c531-f6bd-4dd8-8157-fa85e8bb5c6e admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:51.694852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d82bd-7ece-4714-8e38-2ba901ba0725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:51.695440 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d82bd-7ece-4714-8e38-2ba901ba0725 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.695715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d82bd-7ece-4714-8e38-2ba901ba0725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.696009 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d82bd-7ece-4714-8e38-2ba901ba0725 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.696782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d82bd-7ece-4714-8e38-2ba901ba0725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:51.698740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d82bd-7ece-4714-8e38-2ba901ba0725 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:51.720923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1350/2670] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:51 2022] POST /identity/v3/users => generated 305 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:51.725436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e3c44-278e-4b09-b8b2-5dc1e1eec0da admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:51.736349 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e3c44-278e-4b09-b8b2-5dc1e1eec0da admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:51.748491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824655c-829d-4bda-bec9-7b8ca8095f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:51.749710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824655c-829d-4bda-bec9-7b8ca8095f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.750229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824655c-829d-4bda-bec9-7b8ca8095f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.750743 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824655c-829d-4bda-bec9-7b8ca8095f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.752238 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824655c-829d-4bda-bec9-7b8ca8095f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:51.755434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824655c-829d-4bda-bec9-7b8ca8095f32 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:51.769760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1321/2671] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:51.775689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d82bd-7ece-4714-8e38-2ba901ba0725 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:51.790561 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d82bd-7ece-4714-8e38-2ba901ba0725 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:51.797101 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be02514-cbcc-4bdb-a241-81ce77399ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:51.797828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be02514-cbcc-4bdb-a241-81ce77399ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.798106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be02514-cbcc-4bdb-a241-81ce77399ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.798380 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be02514-cbcc-4bdb-a241-81ce77399ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.799098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be02514-cbcc-4bdb-a241-81ce77399ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:51.801330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be02514-cbcc-4bdb-a241-81ce77399ce6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:51.813529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1351/2672] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:36:51.818284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824655c-829d-4bda-bec9-7b8ca8095f32 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:51.828467 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824655c-829d-4bda-bec9-7b8ca8095f32 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:51.833475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33b1d-db54-4239-a7e1-236b03d5eb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:51.834398 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33b1d-db54-4239-a7e1-236b03d5eb55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.834675 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33b1d-db54-4239-a7e1-236b03d5eb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.834956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a33b1d-db54-4239-a7e1-236b03d5eb55 admin admin] PATH_INFO: `/v3/projects/c80cba2fdafd4ffa996717794cbecc06/users/2927d949adf146b3953f4e55b4d29665/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.853322 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a33b1d-db54-4239-a7e1-236b03d5eb55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80cba2fdafd4ffa996717794cbecc06, user_id=2927d949adf146b3953f4e55b4d29665, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:51.856007 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a33b1d-db54-4239-a7e1-236b03d5eb55 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:51.873202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1322/2673] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:51 2022] PUT /identity/v3/projects/c80cba2fdafd4ffa996717794cbecc06/users/2927d949adf146b3953f4e55b4d29665/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:36:51.885029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8245b-ad71-4e87-84f8-afd72ea51721 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:51.885351 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8245b-ad71-4e87-84f8-afd72ea51721 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:51.885616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8245b-ad71-4e87-84f8-afd72ea51721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:51.914607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-65c8245b-ad71-4e87-84f8-afd72ea51721 None None] MFA Rules not processed for user `2927d949adf146b3953f4e55b4d29665`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:51.915826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-65c8245b-ad71-4e87-84f8-afd72ea51721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:51.984042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1352/2674] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:51.988670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33b1d-db54-4239-a7e1-236b03d5eb55 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:52.057720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a33b1d-db54-4239-a7e1-236b03d5eb55 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:52.062542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53904a-9cf2-4ac8-969b-2dfbe14d981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:52.063206 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53904a-9cf2-4ac8-969b-2dfbe14d981d admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:52.063487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53904a-9cf2-4ac8-969b-2dfbe14d981d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:52.063768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53904a-9cf2-4ac8-969b-2dfbe14d981d admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:52.064454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53904a-9cf2-4ac8-969b-2dfbe14d981d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:52.066474 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53904a-9cf2-4ac8-969b-2dfbe14d981d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:52.094336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1323/2675] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:51 2022] POST /identity/v3/projects => generated 407 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:52.098588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8245b-ad71-4e87-84f8-afd72ea51721 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:52.109500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8245b-ad71-4e87-84f8-afd72ea51721 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:52.122058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:52.179408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90abca-e534-4930-82b7-3d3d570810f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:52.180147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90abca-e534-4930-82b7-3d3d570810f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:52.180361 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90abca-e534-4930-82b7-3d3d570810f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:52.180636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90abca-e534-4930-82b7-3d3d570810f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:52.181358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90abca-e534-4930-82b7-3d3d570810f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:52.183278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90abca-e534-4930-82b7-3d3d570810f6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:52.209920 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1353/2676] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:52 2022] POST /identity/v3/users => generated 310 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:36:52.211132 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53904a-9cf2-4ac8-969b-2dfbe14d981d admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:52.222391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53904a-9cf2-4ac8-969b-2dfbe14d981d admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:52.227559 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b85bd5-875a-417f-beff-282ca09e6333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:52.228240 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85bd5-875a-417f-beff-282ca09e6333 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:52.228525 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85bd5-875a-417f-beff-282ca09e6333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:52.228801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85bd5-875a-417f-beff-282ca09e6333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:52.229581 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b85bd5-875a-417f-beff-282ca09e6333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:52.231211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b85bd5-875a-417f-beff-282ca09e6333 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:52.242783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1324/2677] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:36:52.247051 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90abca-e534-4930-82b7-3d3d570810f6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:52.257601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90abca-e534-4930-82b7-3d3d570810f6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:52.262764 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6825d-c2ef-4e94-92ff-469eef8872ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:52.263659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6825d-c2ef-4e94-92ff-469eef8872ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:52.263937 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6825d-c2ef-4e94-92ff-469eef8872ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:52.264211 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6825d-c2ef-4e94-92ff-469eef8872ad admin admin] PATH_INFO: `/v3/projects/6d9035a94d3640febcaeb3901dcf6fca/users/ecbcfa7e3fb948159e55cf81e0598305/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:52.280943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6825d-c2ef-4e94-92ff-469eef8872ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9035a94d3640febcaeb3901dcf6fca, user_id=ecbcfa7e3fb948159e55cf81e0598305, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:52.283838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6825d-c2ef-4e94-92ff-469eef8872ad admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:52.304303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1354/2678] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:52 2022] PUT /identity/v3/projects/6d9035a94d3640febcaeb3901dcf6fca/users/ecbcfa7e3fb948159e55cf81e0598305/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:52.308444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b85bd5-875a-417f-beff-282ca09e6333 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:52.321500 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b85bd5-875a-417f-beff-282ca09e6333 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:52.357345 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:52.398248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5db86a-98c6-4d80-8e21-cd4959025e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:52.398996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db86a-98c6-4d80-8e21-cd4959025e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:52.399274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db86a-98c6-4d80-8e21-cd4959025e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:52.399543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5db86a-98c6-4d80-8e21-cd4959025e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:52.400280 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5db86a-98c6-4d80-8e21-cd4959025e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:52.402326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5db86a-98c6-4d80-8e21-cd4959025e9c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:52.413950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1325/2679] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:36:52.418741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6825d-c2ef-4e94-92ff-469eef8872ad admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:52.429581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6825d-c2ef-4e94-92ff-469eef8872ad admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:52.434956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d285447-4a68-4688-ad39-41389414f140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:52.435864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d285447-4a68-4688-ad39-41389414f140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:52.436138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d285447-4a68-4688-ad39-41389414f140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:52.436405 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d285447-4a68-4688-ad39-41389414f140 admin admin] PATH_INFO: `/v3/projects/6d9035a94d3640febcaeb3901dcf6fca/users/ecbcfa7e3fb948159e55cf81e0598305/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:52.438528 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d285447-4a68-4688-ad39-41389414f140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9035a94d3640febcaeb3901dcf6fca, user_id=ecbcfa7e3fb948159e55cf81e0598305, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:52.441233 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d285447-4a68-4688-ad39-41389414f140 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:52.455524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1355/2680] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:36:52 2022] PUT /identity/v3/projects/6d9035a94d3640febcaeb3901dcf6fca/users/ecbcfa7e3fb948159e55cf81e0598305/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:52.465688 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e95a3d-6619-4872-a2ef-5c4ca77a260b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:52.465968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e95a3d-6619-4872-a2ef-5c4ca77a260b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:52.466243 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e95a3d-6619-4872-a2ef-5c4ca77a260b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:52.494031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-83e95a3d-6619-4872-a2ef-5c4ca77a260b None None] MFA Rules not processed for user `ecbcfa7e3fb948159e55cf81e0598305`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:52.495180 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-83e95a3d-6619-4872-a2ef-5c4ca77a260b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:52.562102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1326/2681] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:52 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:52.574873 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d285447-4a68-4688-ad39-41389414f140 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:52.576717 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2d285447-4a68-4688-ad39-41389414f140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:52.642655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d285447-4a68-4688-ad39-41389414f140 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:52.646821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27a689-39c8-46f6-b929-b527619ab20b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:52.647504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27a689-39c8-46f6-b929-b527619ab20b service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:52.647788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27a689-39c8-46f6-b929-b527619ab20b service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:52.648061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27a689-39c8-46f6-b929-b527619ab20b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:52.658775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27a689-39c8-46f6-b929-b527619ab20b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:52.660763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27a689-39c8-46f6-b929-b527619ab20b service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:52.670473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1356/2682] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:52 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:52.826712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e95a3d-6619-4872-a2ef-5c4ca77a260b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:52.837553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e95a3d-6619-4872-a2ef-5c4ca77a260b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:52.841224 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ae3ff-9c6d-4e4b-9b9c-f8b9932e4e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:52.841866 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ae3ff-9c6d-4e4b-9b9c-f8b9932e4e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:52.842155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ae3ff-9c6d-4e4b-9b9c-f8b9932e4e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:52.842415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ae3ff-9c6d-4e4b-9b9c-f8b9932e4e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:52.903186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ae3ff-9c6d-4e4b-9b9c-f8b9932e4e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:52.904644 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ae3ff-9c6d-4e4b-9b9c-f8b9932e4e0b service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:52.914244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1327/2683] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:58.331327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27a689-39c8-46f6-b929-b527619ab20b service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:58.396287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27a689-39c8-46f6-b929-b527619ab20b service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:58.400808 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:58.401716 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:58.401990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:58.402261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] PATH_INFO: `/v3/users/2927d949adf146b3953f4e55b4d29665` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:58.403421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2927d949adf146b3953f4e55b4d29665)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:58.405387 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:58.415769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:58.462634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2927d949adf146b3953f4e55b4d29665'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:58.463368 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2927d949adf146b3953f4e55b4d29665'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:58.472265 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2927d949adf146b3953f4e55b4d29665'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:58.479542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2927d949adf146b3953f4e55b4d29665'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:58.480226 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2927d949adf146b3953f4e55b4d29665'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:58.497475 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1357/2684] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:58 2022] DELETE /identity/v3/users/2927d949adf146b3953f4e55b4d29665 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:58.502356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f0a8-d140-4139-a410-d73e150749c2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:58.502878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f0a8-d140-4139-a410-d73e150749c2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:58.502878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f0a8-d140-4139-a410-d73e150749c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:58.521923 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d1d0f0a8-d140-4139-a410-d73e150749c2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:58.523213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d1d0f0a8-d140-4139-a410-d73e150749c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:58.569254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=100 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:58.584875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1328/2685] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:58.594891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:58.596384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:58.667676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0544e5-0c48-4410-8a54-b8d275532e6d admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:58.672251 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e12731-493b-40eb-8f4f-b852f2c1e214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:58.672938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e12731-493b-40eb-8f4f-b852f2c1e214 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:58.673223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e12731-493b-40eb-8f4f-b852f2c1e214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:58.673498 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e12731-493b-40eb-8f4f-b852f2c1e214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:58.685925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e12731-493b-40eb-8f4f-b852f2c1e214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:58.687367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e12731-493b-40eb-8f4f-b852f2c1e214 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:58.697571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1358/2686] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:36:58.986391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f0a8-d140-4139-a410-d73e150749c2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:58.988173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d1d0f0a8-d140-4139-a410-d73e150749c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:59.001996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f0a8-d140-4139-a410-d73e150749c2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:59.008254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:59.009416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:59.009703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:59.009984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] PATH_INFO: `/v3/projects/c80cba2fdafd4ffa996717794cbecc06` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:59.011275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80cba2fdafd4ffa996717794cbecc06)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:59.013422 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:59.070646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80cba2fdafd4ffa996717794cbecc06', 'request_id': 'req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.076594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80cba2fdafd4ffa996717794cbecc06', 'request_id': 'req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.085513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80cba2fdafd4ffa996717794cbecc06', 'request_id': 'req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.097385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] The token cache is being invalidate because project c80cba2fdafd4ffa996717794cbecc06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:59.097729 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.098372 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.099943 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1329/2687] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:58 2022] DELETE /identity/v3/projects/c80cba2fdafd4ffa996717794cbecc06 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:59.104000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e12731-493b-40eb-8f4f-b852f2c1e214 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:59.114159 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e12731-493b-40eb-8f4f-b852f2c1e214 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:59.184335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:59.185780 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:59.186564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:59.186673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] PATH_INFO: `/v3/users/ecbcfa7e3fb948159e55cf81e0598305` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:59.187971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecbcfa7e3fb948159e55cf81e0598305)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:59.190149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:59.229066 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:59.242421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecbcfa7e3fb948159e55cf81e0598305'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.243178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecbcfa7e3fb948159e55cf81e0598305'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.251548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecbcfa7e3fb948159e55cf81e0598305'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.258967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecbcfa7e3fb948159e55cf81e0598305'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.259631 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-0b02deb7-57cd-4fc5-a611-1dc8c163c038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecbcfa7e3fb948159e55cf81e0598305'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.277583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1359/2688] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:36:59 2022] DELETE /identity/v3/users/ecbcfa7e3fb948159e55cf81e0598305 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:59.555095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:59.556575 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:59.569791 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00167f84-b5e5-45df-b5c1-f1ea579b8a4f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:59.629780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:59.630716 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:59.630972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:59.631303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] PATH_INFO: `/v3/projects/6d9035a94d3640febcaeb3901dcf6fca` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:59.632788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9035a94d3640febcaeb3901dcf6fca)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:59.634751 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:59.686548 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9035a94d3640febcaeb3901dcf6fca', 'request_id': 'req-4fe098b0-f7e1-4c29-abb8-516845c23f3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.692520 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9035a94d3640febcaeb3901dcf6fca', 'request_id': 'req-4fe098b0-f7e1-4c29-abb8-516845c23f3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.701384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9035a94d3640febcaeb3901dcf6fca', 'request_id': 'req-4fe098b0-f7e1-4c29-abb8-516845c23f3c'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.713551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] The token cache is being invalidate because project 6d9035a94d3640febcaeb3901dcf6fca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:36:59.713840 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.714534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4fe098b0-f7e1-4c29-abb8-516845c23f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:36:59.716113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1330/2689] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:36:59 2022] DELETE /identity/v3/projects/6d9035a94d3640febcaeb3901dcf6fca => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:36:59.721142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f320e-d3fe-41ac-97ba-22e40dd7ca05 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:59.721634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f320e-d3fe-41ac-97ba-22e40dd7ca05 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:59.721832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f320e-d3fe-41ac-97ba-22e40dd7ca05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:59.740106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-ea4f320e-d3fe-41ac-97ba-22e40dd7ca05 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:59.741284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ea4f320e-d3fe-41ac-97ba-22e40dd7ca05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:59.802895 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1360/2690] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:59.810871 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a5fa-5b4d-4bc6-9438-502bb99ddcde None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:59.811159 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a5fa-5b4d-4bc6-9438-502bb99ddcde None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:59.811434 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424a5fa-5b4d-4bc6-9438-502bb99ddcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:59.819608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:36:59.831473 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e424a5fa-5b4d-4bc6-9438-502bb99ddcde None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:36:59.834028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e424a5fa-5b4d-4bc6-9438-502bb99ddcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:36:59.845768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1331/2691] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:36:59.853904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f320e-d3fe-41ac-97ba-22e40dd7ca05 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:59.864206 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f320e-d3fe-41ac-97ba-22e40dd7ca05 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:59.869761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c3a2-e2bc-4192-98f3-1f52c4c89045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:59.870408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c3a2-e2bc-4192-98f3-1f52c4c89045 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:59.870691 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c3a2-e2bc-4192-98f3-1f52c4c89045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:59.870962 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c3a2-e2bc-4192-98f3-1f52c4c89045 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:59.872371 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c3a2-e2bc-4192-98f3-1f52c4c89045 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:36:59.872684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c3a2-e2bc-4192-98f3-1f52c4c89045 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:59.874348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c3a2-e2bc-4192-98f3-1f52c4c89045 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:59.886871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1361/2692] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:36:59.891481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a5fa-5b4d-4bc6-9438-502bb99ddcde None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:59.901742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424a5fa-5b4d-4bc6-9438-502bb99ddcde None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:36:59.907151 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5f9b1-de4f-4c6d-8fa5-cea700e2bebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:36:59.907802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5f9b1-de4f-4c6d-8fa5-cea700e2bebe admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:36:59.908078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5f9b1-de4f-4c6d-8fa5-cea700e2bebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:36:59.908347 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5f9b1-de4f-4c6d-8fa5-cea700e2bebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:36:59.909068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5f9b1-de4f-4c6d-8fa5-cea700e2bebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:36:59.910980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5f9b1-de4f-4c6d-8fa5-cea700e2bebe admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:36:59.940916 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1332/2693] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:36:59 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:36:59.946406 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c3a2-e2bc-4192-98f3-1f52c4c89045 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:36:59.957634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c3a2-e2bc-4192-98f3-1f52c4c89045 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:00.017232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619477bd-e68b-4222-93a3-cce4f5533be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:00.017815 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619477bd-e68b-4222-93a3-cce4f5533be8 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:00.018096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619477bd-e68b-4222-93a3-cce4f5533be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:00.018364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619477bd-e68b-4222-93a3-cce4f5533be8 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:00.019035 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619477bd-e68b-4222-93a3-cce4f5533be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:00.021033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619477bd-e68b-4222-93a3-cce4f5533be8 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:00.042416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1362/2694] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:36:59 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:37:00.047968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5f9b1-de4f-4c6d-8fa5-cea700e2bebe admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:00.058974 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5f9b1-de4f-4c6d-8fa5-cea700e2bebe admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:00.064579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faa931-b846-40fa-b1c1-5e12e208e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:00.065287 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faa931-b846-40fa-b1c1-5e12e208e5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:00.065549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faa931-b846-40fa-b1c1-5e12e208e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:00.065822 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faa931-b846-40fa-b1c1-5e12e208e5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:00.066614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faa931-b846-40fa-b1c1-5e12e208e5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:00.068214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faa931-b846-40fa-b1c1-5e12e208e5d1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:00.078892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1333/2695] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:37:00.082791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619477bd-e68b-4222-93a3-cce4f5533be8 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:00.093317 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619477bd-e68b-4222-93a3-cce4f5533be8 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:00.098355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3649-a841-480c-9403-3498e83bee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:00.099010 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3649-a841-480c-9403-3498e83bee34 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:00.099364 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3649-a841-480c-9403-3498e83bee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:00.099640 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3649-a841-480c-9403-3498e83bee34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:00.100362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3649-a841-480c-9403-3498e83bee34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:00.101995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3649-a841-480c-9403-3498e83bee34 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:00.112523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1363/2696] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:37:00.116935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faa931-b846-40fa-b1c1-5e12e208e5d1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:00.127750 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faa931-b846-40fa-b1c1-5e12e208e5d1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:00.133102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc57b9-fae3-47ff-aafb-e88ae59d12d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:00.133982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc57b9-fae3-47ff-aafb-e88ae59d12d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:00.134258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc57b9-fae3-47ff-aafb-e88ae59d12d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:00.134535 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc57b9-fae3-47ff-aafb-e88ae59d12d0 admin admin] PATH_INFO: `/v3/projects/f556d7b34bcd4dbab62289c124e6c9a8/users/e528c0a984234bbf84a91e2bd3965ac9/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:00.149837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc57b9-fae3-47ff-aafb-e88ae59d12d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f556d7b34bcd4dbab62289c124e6c9a8, user_id=e528c0a984234bbf84a91e2bd3965ac9, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:00.152490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc57b9-fae3-47ff-aafb-e88ae59d12d0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:00.167472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1334/2697] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:37:00 2022] PUT /identity/v3/projects/f556d7b34bcd4dbab62289c124e6c9a8/users/e528c0a984234bbf84a91e2bd3965ac9/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:00.177817 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6221f7-1b7f-4e61-ba29-07b872a756d0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:00.178130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6221f7-1b7f-4e61-ba29-07b872a756d0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:00.178402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6221f7-1b7f-4e61-ba29-07b872a756d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:00.206583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9d6221f7-1b7f-4e61-ba29-07b872a756d0 None None] MFA Rules not processed for user `e528c0a984234bbf84a91e2bd3965ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:00.207804 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9d6221f7-1b7f-4e61-ba29-07b872a756d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:00.213975 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:00.290347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1364/2698] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:00.303514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc57b9-fae3-47ff-aafb-e88ae59d12d0 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:00.305629 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-53bc57b9-fae3-47ff-aafb-e88ae59d12d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:00.370999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc57b9-fae3-47ff-aafb-e88ae59d12d0 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:00.374954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039d658-b2c0-4692-b5f2-1a409edcf101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:00.375595 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d658-b2c0-4692-b5f2-1a409edcf101 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:00.375869 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d658-b2c0-4692-b5f2-1a409edcf101 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:00.376138 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039d658-b2c0-4692-b5f2-1a409edcf101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:00.384703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d658-b2c0-4692-b5f2-1a409edcf101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:00.386179 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039d658-b2c0-4692-b5f2-1a409edcf101 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:00.396631 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1335/2699] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:00.415860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6221f7-1b7f-4e61-ba29-07b872a756d0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:00.483522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6221f7-1b7f-4e61-ba29-07b872a756d0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:00.488516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:00.489421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:00.489709 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:00.489981 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] PATH_INFO: `/v3/users/e528c0a984234bbf84a91e2bd3965ac9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:00.491230 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e528c0a984234bbf84a91e2bd3965ac9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:00.493195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:00.543342 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e528c0a984234bbf84a91e2bd3965ac9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:00.543939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e528c0a984234bbf84a91e2bd3965ac9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:00.553485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e528c0a984234bbf84a91e2bd3965ac9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:00.560708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e528c0a984234bbf84a91e2bd3965ac9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:00.561444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e528c0a984234bbf84a91e2bd3965ac9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:00.579843 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1365/2700] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:37:00 2022] DELETE /identity/v3/users/e528c0a984234bbf84a91e2bd3965ac9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:00.584837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137bfae-4de0-4984-a171-2db1857c0261 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:00.585339 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137bfae-4de0-4984-a171-2db1857c0261 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:00.585465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137bfae-4de0-4984-a171-2db1857c0261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:00.603158 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a137bfae-4de0-4984-a171-2db1857c0261 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:00.604369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a137bfae-4de0-4984-a171-2db1857c0261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:00.663842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1336/2701] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:00.675906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:00.677660 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:00.708983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:00.744744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a163a6-d89d-4d9f-873a-1835ce84e751 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:00.749460 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb27b1-a62e-4c98-81d6-97dd9ca45aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:00.750112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb27b1-a62e-4c98-81d6-97dd9ca45aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:00.750391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb27b1-a62e-4c98-81d6-97dd9ca45aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:00.750791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb27b1-a62e-4c98-81d6-97dd9ca45aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:00.764832 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb27b1-a62e-4c98-81d6-97dd9ca45aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:00.767333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cb27b1-a62e-4c98-81d6-97dd9ca45aaf service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:00.777809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1366/2702] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:01.053991 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137bfae-4de0-4984-a171-2db1857c0261 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:01.055529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a137bfae-4de0-4984-a171-2db1857c0261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:01.069549 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137bfae-4de0-4984-a171-2db1857c0261 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:01.075795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:01.076790 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.077123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.077356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] PATH_INFO: `/v3/projects/f556d7b34bcd4dbab62289c124e6c9a8` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.078757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f556d7b34bcd4dbab62289c124e6c9a8)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:01.080701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:01.137934 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:01.146388 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f556d7b34bcd4dbab62289c124e6c9a8', 'request_id': 'req-e1a4e940-858a-4286-8784-e3fbe8b27670'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:01.153801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f556d7b34bcd4dbab62289c124e6c9a8', 'request_id': 'req-e1a4e940-858a-4286-8784-e3fbe8b27670'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:01.163756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f556d7b34bcd4dbab62289c124e6c9a8', 'request_id': 'req-e1a4e940-858a-4286-8784-e3fbe8b27670'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:01.175490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] The token cache is being invalidate because project f556d7b34bcd4dbab62289c124e6c9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:37:01.175747 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:01.176359 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e1a4e940-858a-4286-8784-e3fbe8b27670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:01.177995 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1337/2703] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:37:01 2022] DELETE /identity/v3/projects/f556d7b34bcd4dbab62289c124e6c9a8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:37:01.183657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65283662-7223-4702-aefe-cce3adef0a0a None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.183946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65283662-7223-4702-aefe-cce3adef0a0a None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.184225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65283662-7223-4702-aefe-cce3adef0a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.202796 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-65283662-7223-4702-aefe-cce3adef0a0a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:01.204019 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-65283662-7223-4702-aefe-cce3adef0a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:01.270962 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1367/2704] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:01.279235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f68c2a-8245-43bc-a80e-d0db6759d6e0 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.279524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f68c2a-8245-43bc-a80e-d0db6759d6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.279800 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f68c2a-8245-43bc-a80e-d0db6759d6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.299570 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-30f68c2a-8245-43bc-a80e-d0db6759d6e0 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:01.300788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-30f68c2a-8245-43bc-a80e-d0db6759d6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:01.311026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1338/2705] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:01.315428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65283662-7223-4702-aefe-cce3adef0a0a None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:01.326283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65283662-7223-4702-aefe-cce3adef0a0a None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:01.331578 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86b9cb-fbee-4aff-9ab4-8f27b777afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:01.332329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86b9cb-fbee-4aff-9ab4-8f27b777afb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.332524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86b9cb-fbee-4aff-9ab4-8f27b777afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.332884 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86b9cb-fbee-4aff-9ab4-8f27b777afb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.333635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86b9cb-fbee-4aff-9ab4-8f27b777afb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:37:01.333939 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86b9cb-fbee-4aff-9ab4-8f27b777afb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:01.335547 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86b9cb-fbee-4aff-9ab4-8f27b777afb1 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:01.347469 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1368/2706] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:37:01.351831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f68c2a-8245-43bc-a80e-d0db6759d6e0 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:01.361528 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f68c2a-8245-43bc-a80e-d0db6759d6e0 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:01.367175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c01aab-29f5-4054-85f6-848e1c3f4a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:01.367824 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c01aab-29f5-4054-85f6-848e1c3f4a53 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.368104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c01aab-29f5-4054-85f6-848e1c3f4a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.368425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c01aab-29f5-4054-85f6-848e1c3f4a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.369152 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c01aab-29f5-4054-85f6-848e1c3f4a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:01.371073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c01aab-29f5-4054-85f6-848e1c3f4a53 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:01.399227 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1339/2707] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:37:01 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:37:01.405195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86b9cb-fbee-4aff-9ab4-8f27b777afb1 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:01.419904 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86b9cb-fbee-4aff-9ab4-8f27b777afb1 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:01.479131 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088bfdb-1aed-4e76-adcd-997ce9c24124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:01.479799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088bfdb-1aed-4e76-adcd-997ce9c24124 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.480077 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088bfdb-1aed-4e76-adcd-997ce9c24124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.480381 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088bfdb-1aed-4e76-adcd-997ce9c24124 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.481095 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088bfdb-1aed-4e76-adcd-997ce9c24124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:01.483117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088bfdb-1aed-4e76-adcd-997ce9c24124 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:01.506218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1369/2708] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:37:01 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:37:01.511793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c01aab-29f5-4054-85f6-848e1c3f4a53 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:01.523063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c01aab-29f5-4054-85f6-848e1c3f4a53 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:01.528645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4dbad-02b6-48fc-9af2-18660be82f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:01.529391 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4dbad-02b6-48fc-9af2-18660be82f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.529673 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4dbad-02b6-48fc-9af2-18660be82f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.529949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4dbad-02b6-48fc-9af2-18660be82f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.530670 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4dbad-02b6-48fc-9af2-18660be82f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:01.532299 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4dbad-02b6-48fc-9af2-18660be82f82 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:01.543259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1340/2709] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:37:01.547096 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088bfdb-1aed-4e76-adcd-997ce9c24124 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:01.557447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088bfdb-1aed-4e76-adcd-997ce9c24124 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:01.562470 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbadd7b-7cf8-4640-874e-16547c22dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:01.563138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbadd7b-7cf8-4640-874e-16547c22dffb admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.563422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbadd7b-7cf8-4640-874e-16547c22dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.563730 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbadd7b-7cf8-4640-874e-16547c22dffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.564452 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbadd7b-7cf8-4640-874e-16547c22dffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:01.566091 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbadd7b-7cf8-4640-874e-16547c22dffb admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:01.577171 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1370/2710] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:37:01.581432 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4dbad-02b6-48fc-9af2-18660be82f82 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:01.592768 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4dbad-02b6-48fc-9af2-18660be82f82 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:01.598187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d7e93-9d40-40a3-9797-8e24e3c822d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:01.599127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7e93-9d40-40a3-9797-8e24e3c822d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.599407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7e93-9d40-40a3-9797-8e24e3c822d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.599681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6d7e93-9d40-40a3-9797-8e24e3c822d6 admin admin] PATH_INFO: `/v3/projects/03bbebd96c314c56b309fa74de034344/users/cb971a91577740f983fe3b2bc1bd4414/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.615055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d7e93-9d40-40a3-9797-8e24e3c822d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bbebd96c314c56b309fa74de034344, user_id=cb971a91577740f983fe3b2bc1bd4414, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:01.617769 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6d7e93-9d40-40a3-9797-8e24e3c822d6 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:01.634764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1341/2711] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:37:01 2022] PUT /identity/v3/projects/03bbebd96c314c56b309fa74de034344/users/cb971a91577740f983fe3b2bc1bd4414/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:01.701281 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de0656-611b-4a5b-8441-26b4c3c1c5e9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.701509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de0656-611b-4a5b-8441-26b4c3c1c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.701707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de0656-611b-4a5b-8441-26b4c3c1c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.730477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-52de0656-611b-4a5b-8441-26b4c3c1c5e9 None None] MFA Rules not processed for user `cb971a91577740f983fe3b2bc1bd4414`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:01.731741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-52de0656-611b-4a5b-8441-26b4c3c1c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:01.755510 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:01.802543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1371/2712] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:37:01.814143 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d7e93-9d40-40a3-9797-8e24e3c822d6 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:01.815981 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2f6d7e93-9d40-40a3-9797-8e24e3c822d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:01.896940 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6d7e93-9d40-40a3-9797-8e24e3c822d6 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:01.904351 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aafb5-e4d1-4599-b2e1-69d070b82746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:01.905407 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aafb5-e4d1-4599-b2e1-69d070b82746 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:01.905835 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aafb5-e4d1-4599-b2e1-69d070b82746 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:01.906235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aafb5-e4d1-4599-b2e1-69d070b82746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:01.917843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aafb5-e4d1-4599-b2e1-69d070b82746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:01.919319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aafb5-e4d1-4599-b2e1-69d070b82746 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:01.928986 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1342/2713] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:07.317064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de0656-611b-4a5b-8441-26b4c3c1c5e9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:07.384053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de0656-611b-4a5b-8441-26b4c3c1c5e9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:07.393444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:07.394740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:07.395099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:07.395424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] PATH_INFO: `/v3/users/cb971a91577740f983fe3b2bc1bd4414` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:07.397427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb971a91577740f983fe3b2bc1bd4414)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:07.400445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:07.451577 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb971a91577740f983fe3b2bc1bd4414'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:07.452218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb971a91577740f983fe3b2bc1bd4414'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:07.460466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb971a91577740f983fe3b2bc1bd4414'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:07.467892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb971a91577740f983fe3b2bc1bd4414'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:07.468524 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb971a91577740f983fe3b2bc1bd4414'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:07.487016 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1372/2714] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:37:07 2022] DELETE /identity/v3/users/cb971a91577740f983fe3b2bc1bd4414 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:07.494820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01386b-8382-47ac-b187-22cd7dd920d2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:07.495419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01386b-8382-47ac-b187-22cd7dd920d2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:07.495419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01386b-8382-47ac-b187-22cd7dd920d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:07.513586 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8d01386b-8382-47ac-b187-22cd7dd920d2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:07.515072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8d01386b-8382-47ac-b187-22cd7dd920d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:07.582482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1343/2715] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:07.592732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:07.594311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:07.643083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:07.656423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b86093-3d10-49f0-aaef-0c31cc773bc0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:07.660427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee3daa-ce48-4b2b-be37-42ac6f03892b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:07.661187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3daa-ce48-4b2b-be37-42ac6f03892b service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:07.661471 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3daa-ce48-4b2b-be37-42ac6f03892b service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:07.661732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee3daa-ce48-4b2b-be37-42ac6f03892b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:07.671285 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee3daa-ce48-4b2b-be37-42ac6f03892b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:07.672731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee3daa-ce48-4b2b-be37-42ac6f03892b service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:07.682885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1373/2716] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:07.977236 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01386b-8382-47ac-b187-22cd7dd920d2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:07.978687 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8d01386b-8382-47ac-b187-22cd7dd920d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:07.990762 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01386b-8382-47ac-b187-22cd7dd920d2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:07.995516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:07.996385 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:07.996666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:07.996975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] PATH_INFO: `/v3/projects/03bbebd96c314c56b309fa74de034344` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:07.998174 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bbebd96c314c56b309fa74de034344)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:08.000092 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:08.002064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:08.052950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bbebd96c314c56b309fa74de034344', 'request_id': 'req-e49507b2-0fba-44b9-b1d8-a649dc4652ff'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.058926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bbebd96c314c56b309fa74de034344', 'request_id': 'req-e49507b2-0fba-44b9-b1d8-a649dc4652ff'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.067951 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bbebd96c314c56b309fa74de034344', 'request_id': 'req-e49507b2-0fba-44b9-b1d8-a649dc4652ff'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.079475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] The token cache is being invalidate because project 03bbebd96c314c56b309fa74de034344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:37:08.079765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.080395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-e49507b2-0fba-44b9-b1d8-a649dc4652ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.081969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1344/2717] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:37:07 2022] DELETE /identity/v3/projects/03bbebd96c314c56b309fa74de034344 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:08.088214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048cee3-046e-498e-8778-f0996bdd1de0 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.088589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048cee3-046e-498e-8778-f0996bdd1de0 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.089068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048cee3-046e-498e-8778-f0996bdd1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.111252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1048cee3-046e-498e-8778-f0996bdd1de0 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:08.112478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1048cee3-046e-498e-8778-f0996bdd1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:08.186008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1374/2718] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:08.194370 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa9087-c9c0-4417-b73f-414a539f4322 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.194659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa9087-c9c0-4417-b73f-414a539f4322 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.194935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa9087-c9c0-4417-b73f-414a539f4322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.215376 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9daa9087-c9c0-4417-b73f-414a539f4322 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:08.216601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9daa9087-c9c0-4417-b73f-414a539f4322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:08.226237 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1345/2719] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:08.230657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048cee3-046e-498e-8778-f0996bdd1de0 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:08.241067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048cee3-046e-498e-8778-f0996bdd1de0 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:08.246087 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3972a2-03be-4c8e-9d7b-86a02ef77d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:08.246741 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3972a2-03be-4c8e-9d7b-86a02ef77d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.247023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3972a2-03be-4c8e-9d7b-86a02ef77d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.247296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3972a2-03be-4c8e-9d7b-86a02ef77d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.247992 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3972a2-03be-4c8e-9d7b-86a02ef77d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:37:08.248323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3972a2-03be-4c8e-9d7b-86a02ef77d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:08.250002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3972a2-03be-4c8e-9d7b-86a02ef77d00 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:08.262486 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1375/2720] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:37:08.268381 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa9087-c9c0-4417-b73f-414a539f4322 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:08.282064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa9087-c9c0-4417-b73f-414a539f4322 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:08.289820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26a70c-8f9c-4301-9e7f-9f469e19df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:08.290741 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26a70c-8f9c-4301-9e7f-9f469e19df96 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.291055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26a70c-8f9c-4301-9e7f-9f469e19df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.291386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26a70c-8f9c-4301-9e7f-9f469e19df96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.292411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26a70c-8f9c-4301-9e7f-9f469e19df96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:08.294383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26a70c-8f9c-4301-9e7f-9f469e19df96 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:08.323205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1346/2721] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:37:08 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:37:08.327523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3972a2-03be-4c8e-9d7b-86a02ef77d00 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:08.338214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3972a2-03be-4c8e-9d7b-86a02ef77d00 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:08.395604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d195aed-5d08-4e07-81c6-d1761195a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:08.396294 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195aed-5d08-4e07-81c6-d1761195a621 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.396558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195aed-5d08-4e07-81c6-d1761195a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.396838 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d195aed-5d08-4e07-81c6-d1761195a621 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.397555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d195aed-5d08-4e07-81c6-d1761195a621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:08.399490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d195aed-5d08-4e07-81c6-d1761195a621 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:08.421641 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1376/2722] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:37:08 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:37:08.425778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26a70c-8f9c-4301-9e7f-9f469e19df96 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:08.436510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26a70c-8f9c-4301-9e7f-9f469e19df96 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:08.441543 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a894c3-5135-4222-94d3-8b54b5e7260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:08.442203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a894c3-5135-4222-94d3-8b54b5e7260b admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.442482 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a894c3-5135-4222-94d3-8b54b5e7260b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.442758 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a894c3-5135-4222-94d3-8b54b5e7260b admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.443618 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a894c3-5135-4222-94d3-8b54b5e7260b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:08.445275 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a894c3-5135-4222-94d3-8b54b5e7260b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:08.455926 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1347/2723] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:37:08.460408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d195aed-5d08-4e07-81c6-d1761195a621 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:08.477942 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d195aed-5d08-4e07-81c6-d1761195a621 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:08.483954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8db391-cb15-4a8d-bf6c-0f8165c48d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:08.484618 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db391-cb15-4a8d-bf6c-0f8165c48d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.484926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db391-cb15-4a8d-bf6c-0f8165c48d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.485200 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8db391-cb15-4a8d-bf6c-0f8165c48d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.485917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8db391-cb15-4a8d-bf6c-0f8165c48d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:08.487546 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8db391-cb15-4a8d-bf6c-0f8165c48d87 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:08.498323 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1377/2724] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:37:08.502550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a894c3-5135-4222-94d3-8b54b5e7260b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:08.513021 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a894c3-5135-4222-94d3-8b54b5e7260b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:08.517894 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbacb8-c4ff-4f70-a18c-f84a22bbc1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:08.518761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbacb8-c4ff-4f70-a18c-f84a22bbc1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.519044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbacb8-c4ff-4f70-a18c-f84a22bbc1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.519319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbacb8-c4ff-4f70-a18c-f84a22bbc1e4 admin admin] PATH_INFO: `/v3/projects/1af1ff02bb7f4bd081028ba62eb8714e/users/5e778247f8744722b0cd12b39a9eab93/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.534220 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbacb8-c4ff-4f70-a18c-f84a22bbc1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af1ff02bb7f4bd081028ba62eb8714e, user_id=5e778247f8744722b0cd12b39a9eab93, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:08.537039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbacb8-c4ff-4f70-a18c-f84a22bbc1e4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:08.552998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1348/2725] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:37:08 2022] PUT /identity/v3/projects/1af1ff02bb7f4bd081028ba62eb8714e/users/5e778247f8744722b0cd12b39a9eab93/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:37:08.564484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced6ea8-d48c-4824-a8c2-5a541db171f9 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.564976 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced6ea8-d48c-4824-a8c2-5a541db171f9 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.565450 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced6ea8-d48c-4824-a8c2-5a541db171f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.602795 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8ced6ea8-d48c-4824-a8c2-5a541db171f9 None None] MFA Rules not processed for user `5e778247f8744722b0cd12b39a9eab93`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:08.604021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8ced6ea8-d48c-4824-a8c2-5a541db171f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:08.646425 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:08.671589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1378/2726] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:37:08.683503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbacb8-c4ff-4f70-a18c-f84a22bbc1e4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:08.685707 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-07cbacb8-c4ff-4f70-a18c-f84a22bbc1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:08.755554 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbacb8-c4ff-4f70-a18c-f84a22bbc1e4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:08.759539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146a651-ed53-4c00-a569-62219513e709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:08.760189 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146a651-ed53-4c00-a569-62219513e709 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.760477 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146a651-ed53-4c00-a569-62219513e709 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.760744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146a651-ed53-4c00-a569-62219513e709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.769435 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146a651-ed53-4c00-a569-62219513e709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:08.770887 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146a651-ed53-4c00-a569-62219513e709 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:08.779793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1349/2727] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:08.804268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced6ea8-d48c-4824-a8c2-5a541db171f9 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:08.868204 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced6ea8-d48c-4824-a8c2-5a541db171f9 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:08.873508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:08.874399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.874680 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.874980 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] PATH_INFO: `/v3/users/5e778247f8744722b0cd12b39a9eab93` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.876343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e778247f8744722b0cd12b39a9eab93)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:08.878362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:08.933536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e778247f8744722b0cd12b39a9eab93'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.934031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e778247f8744722b0cd12b39a9eab93'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.943791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e778247f8744722b0cd12b39a9eab93'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.951189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e778247f8744722b0cd12b39a9eab93'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.951837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e778247f8744722b0cd12b39a9eab93'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:08.969892 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1379/2728] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:37:08 2022] DELETE /identity/v3/users/5e778247f8744722b0cd12b39a9eab93 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:08.974609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1558c-b09d-46d7-9079-717cfc40940b None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:08.974907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1558c-b09d-46d7-9079-717cfc40940b None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:08.975207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1558c-b09d-46d7-9079-717cfc40940b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:08.994739 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-f8f1558c-b09d-46d7-9079-717cfc40940b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:08.996039 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f8f1558c-b09d-46d7-9079-717cfc40940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:09.025361 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:09.063668 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1350/2729] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:09.073648 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:09.075400 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:09.137886 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb75614-0f08-4169-b332-0627f8b0459a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:09.141898 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fc9e4-d27a-4601-a784-ffc25134c423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:09.142548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fc9e4-d27a-4601-a784-ffc25134c423 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:09.142829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fc9e4-d27a-4601-a784-ffc25134c423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:09.143102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fc9e4-d27a-4601-a784-ffc25134c423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:09.152636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fc9e4-d27a-4601-a784-ffc25134c423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:09.154118 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fc9e4-d27a-4601-a784-ffc25134c423 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:09.163651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1380/2730] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:09.464760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1558c-b09d-46d7-9079-717cfc40940b None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:09.466353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f8f1558c-b09d-46d7-9079-717cfc40940b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:09.478931 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1558c-b09d-46d7-9079-717cfc40940b None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:09.484556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:09.485478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:09.485765 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:09.486036 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] PATH_INFO: `/v3/projects/1af1ff02bb7f4bd081028ba62eb8714e` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:09.487324 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af1ff02bb7f4bd081028ba62eb8714e)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:09.489390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:09.540135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af1ff02bb7f4bd081028ba62eb8714e', 'request_id': 'req-3334d449-cada-4403-b463-e736a0c81df0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:09.546514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af1ff02bb7f4bd081028ba62eb8714e', 'request_id': 'req-3334d449-cada-4403-b463-e736a0c81df0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:09.556564 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af1ff02bb7f4bd081028ba62eb8714e', 'request_id': 'req-3334d449-cada-4403-b463-e736a0c81df0'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:09.568973 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] The token cache is being invalidate because project 1af1ff02bb7f4bd081028ba62eb8714e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:37:09.569289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:09.570041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-3334d449-cada-4403-b463-e736a0c81df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:37:09.573579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1351/2731] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:37:09 2022] DELETE /identity/v3/projects/1af1ff02bb7f4bd081028ba62eb8714e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:09.579187 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e640-e68c-496a-b1b8-7fd6e9381925 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:09.579684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e640-e68c-496a-b1b8-7fd6e9381925 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:09.579684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e640-e68c-496a-b1b8-7fd6e9381925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:09.587605 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:09.604115 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-53e9e640-e68c-496a-b1b8-7fd6e9381925 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:09.606994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-53e9e640-e68c-496a-b1b8-7fd6e9381925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:09.675487 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1381/2732] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:09.686060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a0f61-43c7-448b-8f2f-7b0d9dbd3722 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:09.686510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a0f61-43c7-448b-8f2f-7b0d9dbd3722 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:09.686954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a0f61-43c7-448b-8f2f-7b0d9dbd3722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:09.713211 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-4a7a0f61-43c7-448b-8f2f-7b0d9dbd3722 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:09.714459 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4a7a0f61-43c7-448b-8f2f-7b0d9dbd3722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:09.727458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1352/2733] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:09.732141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e640-e68c-496a-b1b8-7fd6e9381925 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:09.742799 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e640-e68c-496a-b1b8-7fd6e9381925 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:09.748256 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2d86-7730-4c4b-8fe3-0df4eddd7fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:09.748965 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2d86-7730-4c4b-8fe3-0df4eddd7fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:09.749245 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2d86-7730-4c4b-8fe3-0df4eddd7fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:09.749514 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f2d86-7730-4c4b-8fe3-0df4eddd7fe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:09.750274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2d86-7730-4c4b-8fe3-0df4eddd7fe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:37:09.750580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2d86-7730-4c4b-8fe3-0df4eddd7fe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:09.752374 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f2d86-7730-4c4b-8fe3-0df4eddd7fe4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:09.764751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1382/2734] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:37:09.770503 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a0f61-43c7-448b-8f2f-7b0d9dbd3722 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:09.780661 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a0f61-43c7-448b-8f2f-7b0d9dbd3722 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:09.785889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d3552-c217-481b-9df6-a8ef0c25f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:09.786517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d3552-c217-481b-9df6-a8ef0c25f66f admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:09.786799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d3552-c217-481b-9df6-a8ef0c25f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:09.787072 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d3552-c217-481b-9df6-a8ef0c25f66f admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:09.787789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d3552-c217-481b-9df6-a8ef0c25f66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:09.789793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d3552-c217-481b-9df6-a8ef0c25f66f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:09.823226 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1353/2735] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:37:09 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:37:09.827953 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2d86-7730-4c4b-8fe3-0df4eddd7fe4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:09.839787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f2d86-7730-4c4b-8fe3-0df4eddd7fe4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:09.904054 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8341c38-21bb-4765-af45-3fe6ec650204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:09.904747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8341c38-21bb-4765-af45-3fe6ec650204 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:09.905039 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8341c38-21bb-4765-af45-3fe6ec650204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:09.905316 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8341c38-21bb-4765-af45-3fe6ec650204 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:09.906021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8341c38-21bb-4765-af45-3fe6ec650204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:09.907972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8341c38-21bb-4765-af45-3fe6ec650204 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:09.938568 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1383/2736] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:37:09 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:37:09.942935 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d3552-c217-481b-9df6-a8ef0c25f66f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:09.953968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d3552-c217-481b-9df6-a8ef0c25f66f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:09.960113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33114b-13ba-43d9-9e7c-19b1f1dd92da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:09.960113 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33114b-13ba-43d9-9e7c-19b1f1dd92da admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:09.960440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33114b-13ba-43d9-9e7c-19b1f1dd92da admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:09.960614 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33114b-13ba-43d9-9e7c-19b1f1dd92da admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:09.961736 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33114b-13ba-43d9-9e7c-19b1f1dd92da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:09.963342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33114b-13ba-43d9-9e7c-19b1f1dd92da admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:09.975268 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1354/2737] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:37:09.979697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8341c38-21bb-4765-af45-3fe6ec650204 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:09.990241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8341c38-21bb-4765-af45-3fe6ec650204 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:09.996346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2ea28-d477-4361-8609-1afbfd5b53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:09.997064 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2ea28-d477-4361-8609-1afbfd5b53ba admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:09.997348 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2ea28-d477-4361-8609-1afbfd5b53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:09.997615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2ea28-d477-4361-8609-1afbfd5b53ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:09.998359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2ea28-d477-4361-8609-1afbfd5b53ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:10.000032 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2ea28-d477-4361-8609-1afbfd5b53ba admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:10.012188 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1384/2738] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:37:10.016646 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33114b-13ba-43d9-9e7c-19b1f1dd92da admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:10.028107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33114b-13ba-43d9-9e7c-19b1f1dd92da admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:10.033073 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fc1cb-70b3-437b-a459-2bf5911f35d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:10.033968 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fc1cb-70b3-437b-a459-2bf5911f35d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:10.034259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fc1cb-70b3-437b-a459-2bf5911f35d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:10.034534 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034fc1cb-70b3-437b-a459-2bf5911f35d3 admin admin] PATH_INFO: `/v3/projects/cefe0586e4d7464d91db2b682bbde081/users/412407ba04da4f24a2d7827d3d5164dd/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:10.051353 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fc1cb-70b3-437b-a459-2bf5911f35d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefe0586e4d7464d91db2b682bbde081, user_id=412407ba04da4f24a2d7827d3d5164dd, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:10.054123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034fc1cb-70b3-437b-a459-2bf5911f35d3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:10.073417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1355/2739] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:37:10 2022] PUT /identity/v3/projects/cefe0586e4d7464d91db2b682bbde081/users/412407ba04da4f24a2d7827d3d5164dd/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:10.078682 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163630c-d808-4774-adb5-1f6da6064985 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:10.078970 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163630c-d808-4774-adb5-1f6da6064985 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:10.079244 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163630c-d808-4774-adb5-1f6da6064985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:10.104195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1163630c-d808-4774-adb5-1f6da6064985 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:10.106061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1163630c-d808-4774-adb5-1f6da6064985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:10.173292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1385/2740] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:10.186203 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fc1cb-70b3-437b-a459-2bf5911f35d3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:10.188551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-034fc1cb-70b3-437b-a459-2bf5911f35d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:10.248449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:10.252464 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034fc1cb-70b3-437b-a459-2bf5911f35d3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:10.257437 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d320e-adc0-47df-8052-ee4224a162b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:10.258106 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d320e-adc0-47df-8052-ee4224a162b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:10.258392 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d320e-adc0-47df-8052-ee4224a162b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:10.258671 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d320e-adc0-47df-8052-ee4224a162b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:10.271320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d320e-adc0-47df-8052-ee4224a162b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:10.273153 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d320e-adc0-47df-8052-ee4224a162b5 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:10.285932 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1356/2741] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:14.215320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ecd3f-7f93-46ff-9d5a-281cd90dea4d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:14.215851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ecd3f-7f93-46ff-9d5a-281cd90dea4d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:14.215851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177ecd3f-7f93-46ff-9d5a-281cd90dea4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:14.247807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:14.260249 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-177ecd3f-7f93-46ff-9d5a-281cd90dea4d None None] MFA Rules not processed for user `412407ba04da4f24a2d7827d3d5164dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:14.261053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-177ecd3f-7f93-46ff-9d5a-281cd90dea4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:14.327068 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1386/2742] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:14.331591 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d320e-adc0-47df-8052-ee4224a162b5 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:14.342154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d320e-adc0-47df-8052-ee4224a162b5 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:14.346773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edb050-24d4-49f9-8a8c-3780ddde24c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:14.347433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb050-24d4-49f9-8a8c-3780ddde24c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:14.347715 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb050-24d4-49f9-8a8c-3780ddde24c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:14.347994 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb050-24d4-49f9-8a8c-3780ddde24c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:14.348681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edb050-24d4-49f9-8a8c-3780ddde24c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:14.350652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edb050-24d4-49f9-8a8c-3780ddde24c7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:14.381774 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1357/2743] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:37:14 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:37:14.383106 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ecd3f-7f93-46ff-9d5a-281cd90dea4d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:14.395287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177ecd3f-7f93-46ff-9d5a-281cd90dea4d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:14.470427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd419f-2f97-4595-a632-3f8ead0ff39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:14.471117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd419f-2f97-4595-a632-3f8ead0ff39c admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:14.471399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd419f-2f97-4595-a632-3f8ead0ff39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:14.471700 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd419f-2f97-4595-a632-3f8ead0ff39c admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:14.472535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd419f-2f97-4595-a632-3f8ead0ff39c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:14.474548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd419f-2f97-4595-a632-3f8ead0ff39c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:14.499084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1387/2744] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:37:14 2022] POST /identity/v3/users => generated 299 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:37:14.503252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edb050-24d4-49f9-8a8c-3780ddde24c7 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:14.515948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edb050-24d4-49f9-8a8c-3780ddde24c7 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:14.520793 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d66f8-b590-45cc-bb59-57a014f647a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:14.521516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d66f8-b590-45cc-bb59-57a014f647a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:14.521795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d66f8-b590-45cc-bb59-57a014f647a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:14.522071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d66f8-b590-45cc-bb59-57a014f647a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:14.522804 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d66f8-b590-45cc-bb59-57a014f647a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:14.524436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d66f8-b590-45cc-bb59-57a014f647a4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:14.535972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1358/2745] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:37:14.540481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd419f-2f97-4595-a632-3f8ead0ff39c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:14.551037 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd419f-2f97-4595-a632-3f8ead0ff39c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:14.556625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c6abd-fe28-4850-9947-0ac8ed5b14ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:14.557571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c6abd-fe28-4850-9947-0ac8ed5b14ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:14.557915 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c6abd-fe28-4850-9947-0ac8ed5b14ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:14.558194 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c6abd-fe28-4850-9947-0ac8ed5b14ed admin admin] PATH_INFO: `/v3/projects/a3eb80faea8a43ecaf1c5a1eec285d55/users/a8f8c1ab6ba0442a815a016e3f0936c9/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:14.574788 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c6abd-fe28-4850-9947-0ac8ed5b14ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3eb80faea8a43ecaf1c5a1eec285d55, user_id=a8f8c1ab6ba0442a815a016e3f0936c9, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:14.577526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c6abd-fe28-4850-9947-0ac8ed5b14ed admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:14.593274 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1388/2746] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:37:14 2022] PUT /identity/v3/projects/a3eb80faea8a43ecaf1c5a1eec285d55/users/a8f8c1ab6ba0442a815a016e3f0936c9/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:14.597368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d66f8-b590-45cc-bb59-57a014f647a4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:14.608209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d66f8-b590-45cc-bb59-57a014f647a4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:14.669344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d8522-fadb-43e5-bdaa-0bb632ad1b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:14.669948 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8522-fadb-43e5-bdaa-0bb632ad1b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:14.670233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8522-fadb-43e5-bdaa-0bb632ad1b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:14.670511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d8522-fadb-43e5-bdaa-0bb632ad1b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:14.671258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8522-fadb-43e5-bdaa-0bb632ad1b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:14.673126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d8522-fadb-43e5-bdaa-0bb632ad1b53 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:14.684366 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1359/2747] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:37:14.688506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c6abd-fe28-4850-9947-0ac8ed5b14ed admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:14.699021 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c6abd-fe28-4850-9947-0ac8ed5b14ed admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:14.703652 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60046c-b2ad-46f6-97bf-c2d5c615ac6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:14.704558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60046c-b2ad-46f6-97bf-c2d5c615ac6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:14.704875 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60046c-b2ad-46f6-97bf-c2d5c615ac6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:14.705143 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60046c-b2ad-46f6-97bf-c2d5c615ac6b admin admin] PATH_INFO: `/v3/projects/a3eb80faea8a43ecaf1c5a1eec285d55/users/a8f8c1ab6ba0442a815a016e3f0936c9/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:14.707127 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60046c-b2ad-46f6-97bf-c2d5c615ac6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3eb80faea8a43ecaf1c5a1eec285d55, user_id=a8f8c1ab6ba0442a815a016e3f0936c9, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:14.709978 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60046c-b2ad-46f6-97bf-c2d5c615ac6b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:14.721583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1389/2748] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:37:14 2022] PUT /identity/v3/projects/a3eb80faea8a43ecaf1c5a1eec285d55/users/a8f8c1ab6ba0442a815a016e3f0936c9/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:37:19.256659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0bbf8-38e6-469f-b3db-4390e510dbfc None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:19.257305 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0bbf8-38e6-469f-b3db-4390e510dbfc None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:19.257442 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0bbf8-38e6-469f-b3db-4390e510dbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:19.288075 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-cca0bbf8-38e6-469f-b3db-4390e510dbfc None None] MFA Rules not processed for user `a8f8c1ab6ba0442a815a016e3f0936c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:19.289356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-cca0bbf8-38e6-469f-b3db-4390e510dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:19.367430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1360/2749] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:19.380330 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60046c-b2ad-46f6-97bf-c2d5c615ac6b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:19.382426 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-4c60046c-b2ad-46f6-97bf-c2d5c615ac6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:19.439662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60046c-b2ad-46f6-97bf-c2d5c615ac6b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:19.443388 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c59ab6-dae0-4aaf-8029-9256afbb572d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87a4ed0881004eef94166ace450b8a63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:19.444036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c59ab6-dae0-4aaf-8029-9256afbb572d service glance] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:19.444311 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c59ab6-dae0-4aaf-8029-9256afbb572d service glance] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:19.444582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c59ab6-dae0-4aaf-8029-9256afbb572d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:19.448944 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:19.503767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c59ab6-dae0-4aaf-8029-9256afbb572d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:19.505261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c59ab6-dae0-4aaf-8029-9256afbb572d service glance] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:19.514779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1390/2750] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:19.629883 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d1273-6d05-488d-893d-a7c2c27a2a27 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:19.630173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d1273-6d05-488d-893d-a7c2c27a2a27 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:19.630455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412d1273-6d05-488d-893d-a7c2c27a2a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:19.649727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-412d1273-6d05-488d-893d-a7c2c27a2a27 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:19.650984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-412d1273-6d05-488d-893d-a7c2c27a2a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:19.692905 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:19.719071 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1361/2751] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:37:19.731318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c59ab6-dae0-4aaf-8029-9256afbb572d service glance] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:19.733697 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-83c59ab6-dae0-4aaf-8029-9256afbb572d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:19.837075 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c59ab6-dae0-4aaf-8029-9256afbb572d service glance] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:19.844757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94cb8-e9df-4efd-a364-3e23cd31e37c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:19.845447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94cb8-e9df-4efd-a364-3e23cd31e37c service swift] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:19.845724 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94cb8-e9df-4efd-a364-3e23cd31e37c service swift] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:19.845994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94cb8-e9df-4efd-a364-3e23cd31e37c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:19.860721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f94cb8-e9df-4efd-a364-3e23cd31e37c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:19.862437 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f94cb8-e9df-4efd-a364-3e23cd31e37c service swift] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:19.872685 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1391/2752] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:37:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:37:28.379119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff0f62-ce30-4259-9df0-3afedc13d76a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:28.379652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff0f62-ce30-4259-9df0-3afedc13d76a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:28.379652 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff0f62-ce30-4259-9df0-3afedc13d76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:28.398898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-8dff0f62-ce30-4259-9df0-3afedc13d76a None None] MFA Rules not processed for user `412407ba04da4f24a2d7827d3d5164dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:28.400119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-8dff0f62-ce30-4259-9df0-3afedc13d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:28.408456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1362/2753] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:29.870529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=57 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:30.290745 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700b059-4006-4436-8a66-73b0c8cef185 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:30.291059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700b059-4006-4436-8a66-73b0c8cef185 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:30.291338 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700b059-4006-4436-8a66-73b0c8cef185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:30.310070 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0700b059-4006-4436-8a66-73b0c8cef185 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:30.311426 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0700b059-4006-4436-8a66-73b0c8cef185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:30.319582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1392/2754] 10.222.0.59 () {58 vars in 1009 bytes} [Fri Jul 1 16:37:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:30.332954 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff0f62-ce30-4259-9df0-3afedc13d76a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:30.345757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff0f62-ce30-4259-9df0-3afedc13d76a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:30.351202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c593180-5327-4c5c-9fdc-8cd0bc995ea3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:30.351945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c593180-5327-4c5c-9fdc-8cd0bc995ea3 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:30.352248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c593180-5327-4c5c-9fdc-8cd0bc995ea3 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:30.352507 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c593180-5327-4c5c-9fdc-8cd0bc995ea3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:30.360994 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c593180-5327-4c5c-9fdc-8cd0bc995ea3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:30.362606 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c593180-5327-4c5c-9fdc-8cd0bc995ea3 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:30.370858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1363/2755] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:37:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:37:40.304801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:40.368982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=16 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:42.244701 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60416f-2af2-4033-a9d7-e013a8c1e94c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:42.245302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60416f-2af2-4033-a9d7-e013a8c1e94c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:42.245302 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60416f-2af2-4033-a9d7-e013a8c1e94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:42.265018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-0e60416f-2af2-4033-a9d7-e013a8c1e94c None None] MFA Rules not processed for user `0cf6852ab4cf4c80a11f9b2d72ab01d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:37:42.266225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0e60416f-2af2-4033-a9d7-e013a8c1e94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:42.325018 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1393/2756] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:37:42.654960 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c593180-5327-4c5c-9fdc-8cd0bc995ea3 service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:42.713167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c593180-5327-4c5c-9fdc-8cd0bc995ea3 service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:42.717382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:42.718062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:42.718317 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:42.718592 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:42.720827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:42.730990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:42.732445 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:42.740699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1364/2757] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:51.975521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60416f-2af2-4033-a9d7-e013a8c1e94c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:51.977744 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-0e60416f-2af2-4033-a9d7-e013a8c1e94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:51.994996 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60416f-2af2-4033-a9d7-e013a8c1e94c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:51.999695 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6df1f1-6af8-4ca4-be54-7ac8764e18b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:52.000346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6df1f1-6af8-4ca4-be54-7ac8764e18b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:52.000630 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6df1f1-6af8-4ca4-be54-7ac8764e18b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:52.000943 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6df1f1-6af8-4ca4-be54-7ac8764e18b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:52.010676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6df1f1-6af8-4ca4-be54-7ac8764e18b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:52.012136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6df1f1-6af8-4ca4-be54-7ac8764e18b9 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:52.022103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1394/2758] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:37:52.736911 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=26 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:37:53.652685 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:37:53.654168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:53.750296 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d907e4-fb85-4467-b3e3-c201c010677c service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:37:53.757393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:37:53.758155 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:37:53.758436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:37:53.758760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:37:53.760901 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:37:53.779214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:37:53.781862 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:37:53.804451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1365/2759] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:37:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:38:02.017769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=31 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:38:03.794516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=34 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:38:46.109209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f3beb-e905-407f-9c62-1fdef984e8a7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:38:46.109767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f3beb-e905-407f-9c62-1fdef984e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:38:46.109767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f3beb-e905-407f-9c62-1fdef984e8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:38:46.127999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-db5f3beb-e905-407f-9c62-1fdef984e8a7 None None] MFA Rules not processed for user `0cf6852ab4cf4c80a11f9b2d72ab01d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:38:46.129268 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-db5f3beb-e905-407f-9c62-1fdef984e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:38:46.136412 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1395/2760] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:38:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:38:56.122455 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:39:14.523886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:39:14.525441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:39:14.598469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fe826-c5e5-4072-b44b-923cb8cdf410 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:39:14.604870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db0089-3d09-4c20-b9c3-660ff369e5ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:39:14.605530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db0089-3d09-4c20-b9c3-660ff369e5ae service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:14.605829 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db0089-3d09-4c20-b9c3-660ff369e5ae service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:14.606096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db0089-3d09-4c20-b9c3-660ff369e5ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:14.608181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-15db0089-3d09-4c20-b9c3-660ff369e5ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:39:14.620320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db0089-3d09-4c20-b9c3-660ff369e5ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:39:14.621962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db0089-3d09-4c20-b9c3-660ff369e5ae service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:39:14.631861 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1366/2761] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:39:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:39:15.469190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45c26-4c21-4afd-9ddf-b46d36759b34 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:15.469668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45c26-4c21-4afd-9ddf-b46d36759b34 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:15.469772 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45c26-4c21-4afd-9ddf-b46d36759b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:15.487653 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-8af45c26-4c21-4afd-9ddf-b46d36759b34 None None] MFA Rules not processed for user `437bdb7c923e483eb39f448c42e4e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:39:15.488827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8af45c26-4c21-4afd-9ddf-b46d36759b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:39:15.496393 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1396/2762] 10.222.0.59 () {58 vars in 967 bytes} [Fri Jul 1 16:39:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:39:15.535885 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db0089-3d09-4c20-b9c3-660ff369e5ae service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:39:15.548005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db0089-3d09-4c20-b9c3-660ff369e5ae service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:39:15.554031 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579bc0-52e6-4af0-b330-f4b4ceed21a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7db0ec167b464cfea43931cd3c6183e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:39:15.554681 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579bc0-52e6-4af0-b330-f4b4ceed21a8 service swift] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:15.554962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579bc0-52e6-4af0-b330-f4b4ceed21a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:15.555236 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e579bc0-52e6-4af0-b330-f4b4ceed21a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:15.563706 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579bc0-52e6-4af0-b330-f4b4ceed21a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:39:15.565363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e579bc0-52e6-4af0-b330-f4b4ceed21a8 service swift] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:39:15.574014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1367/2763] 10.222.0.59 () {60 vars in 1384 bytes} [Fri Jul 1 16:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 01 16:39:19.248608 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45c26-4c21-4afd-9ddf-b46d36759b34 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:39:19.250739 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8af45c26-4c21-4afd-9ddf-b46d36759b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:39:19.266573 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45c26-4c21-4afd-9ddf-b46d36759b34 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:39:19.272949 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95949779-5296-4c8a-9b5f-5c1b287d5571 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:39:19.273571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95949779-5296-4c8a-9b5f-5c1b287d5571 service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:19.273852 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95949779-5296-4c8a-9b5f-5c1b287d5571 service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:19.274124 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95949779-5296-4c8a-9b5f-5c1b287d5571 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:19.275973 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-95949779-5296-4c8a-9b5f-5c1b287d5571 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:39:19.288501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95949779-5296-4c8a-9b5f-5c1b287d5571 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:39:19.290604 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95949779-5296-4c8a-9b5f-5c1b287d5571 service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:39:19.301539 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1397/2764] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:39:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:39:22.418105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579bc0-52e6-4af0-b330-f4b4ceed21a8 service swift] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:39:22.430956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e579bc0-52e6-4af0-b330-f4b4ceed21a8 service swift] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:39:22.436350 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606a345-13fc-44b4-b45c-6d9d03d9a664 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:39:22.437055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606a345-13fc-44b4-b45c-6d9d03d9a664 service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:22.437337 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606a345-13fc-44b4-b45c-6d9d03d9a664 service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:22.437612 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606a345-13fc-44b4-b45c-6d9d03d9a664 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:22.439443 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2606a345-13fc-44b4-b45c-6d9d03d9a664 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:39:22.453259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606a345-13fc-44b4-b45c-6d9d03d9a664 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:39:22.455057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606a345-13fc-44b4-b45c-6d9d03d9a664 service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:39:22.475285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1368/2765] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:39:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:39:22.486014 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95949779-5296-4c8a-9b5f-5c1b287d5571 service placement] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:39:22.549766 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95949779-5296-4c8a-9b5f-5c1b287d5571 service placement] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:39:22.554189 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:39:22.555099 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:22.555382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:22.555715 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] PATH_INFO: `/v3/users/412407ba04da4f24a2d7827d3d5164dd` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:22.556923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412407ba04da4f24a2d7827d3d5164dd)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:39:22.558853 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:39:22.607333 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412407ba04da4f24a2d7827d3d5164dd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.608023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412407ba04da4f24a2d7827d3d5164dd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.615868 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412407ba04da4f24a2d7827d3d5164dd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.623761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412407ba04da4f24a2d7827d3d5164dd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.624441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412407ba04da4f24a2d7827d3d5164dd'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.642175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1398/2766] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:39:22 2022] DELETE /identity/v3/users/412407ba04da4f24a2d7827d3d5164dd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:39:22.822950 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606a345-13fc-44b4-b45c-6d9d03d9a664 service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:39:22.835271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606a345-13fc-44b4-b45c-6d9d03d9a664 service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:39:22.894454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:39:22.895329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:22.895609 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:22.895886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] PATH_INFO: `/v3/projects/cefe0586e4d7464d91db2b682bbde081` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:22.897129 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefe0586e4d7464d91db2b682bbde081)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:39:22.899063 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:39:22.954607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefe0586e4d7464d91db2b682bbde081', 'request_id': 'req-f9b03137-4efd-4029-ad0f-65a3a6db22c4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.960713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefe0586e4d7464d91db2b682bbde081', 'request_id': 'req-f9b03137-4efd-4029-ad0f-65a3a6db22c4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.970579 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefe0586e4d7464d91db2b682bbde081', 'request_id': 'req-f9b03137-4efd-4029-ad0f-65a3a6db22c4'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.971780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:39:22.984472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] The token cache is being invalidate because project cefe0586e4d7464d91db2b682bbde081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:39:22.985332 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.986079 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:22.987851 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1369/2767] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:39:22 2022] DELETE /identity/v3/projects/cefe0586e4d7464d91db2b682bbde081 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:39:22.992047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:39:22.993525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:39:23.012138 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476365-d627-4157-b605-842f20092dc7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:39:23.085670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:39:23.086571 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:23.086858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:23.087337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] PATH_INFO: `/v3/users/a8f8c1ab6ba0442a815a016e3f0936c9` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:23.088659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8f8c1ab6ba0442a815a016e3f0936c9)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:39:23.090335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:39:23.092327 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:39:23.145232 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8f8c1ab6ba0442a815a016e3f0936c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.145874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8f8c1ab6ba0442a815a016e3f0936c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.154318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8f8c1ab6ba0442a815a016e3f0936c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.161255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8f8c1ab6ba0442a815a016e3f0936c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.161880 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-476b4115-17f7-411b-9d87-e8ef7bd3df9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8f8c1ab6ba0442a815a016e3f0936c9'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.183241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1399/2768] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:39:22 2022] DELETE /identity/v3/users/a8f8c1ab6ba0442a815a016e3f0936c9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:39:23.361096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:39:23.362514 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:39:23.375494 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b03137-4efd-4029-ad0f-65a3a6db22c4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:39:23.437127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:39:23.437999 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:23.438277 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:23.438556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] PATH_INFO: `/v3/projects/a3eb80faea8a43ecaf1c5a1eec285d55` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:23.439764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3eb80faea8a43ecaf1c5a1eec285d55)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:39:23.441756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:39:23.494285 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3eb80faea8a43ecaf1c5a1eec285d55', 'request_id': 'req-bb4df440-f3b7-42ae-a554-6f14c129c555'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.499833 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3eb80faea8a43ecaf1c5a1eec285d55', 'request_id': 'req-bb4df440-f3b7-42ae-a554-6f14c129c555'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.509573 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3eb80faea8a43ecaf1c5a1eec285d55', 'request_id': 'req-bb4df440-f3b7-42ae-a554-6f14c129c555'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.521358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] The token cache is being invalidate because project a3eb80faea8a43ecaf1c5a1eec285d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:39:23.521647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.522321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:39:23.523961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1370/2769] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:39:23 2022] DELETE /identity/v3/projects/a3eb80faea8a43ecaf1c5a1eec285d55 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:39:33.179564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:39:33.518067 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:39:43.469049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269c7f-37c7-4528-8c80-ce7aaf38c952 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:39:43.469901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269c7f-37c7-4528-8c80-ce7aaf38c952 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:39:43.469901 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f269c7f-37c7-4528-8c80-ce7aaf38c952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:39:43.492029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-9f269c7f-37c7-4528-8c80-ce7aaf38c952 None None] MFA Rules not processed for user `0cf6852ab4cf4c80a11f9b2d72ab01d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:39:43.493924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9f269c7f-37c7-4528-8c80-ce7aaf38c952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:39:43.554955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1400/2770] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:39:53.547347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=25 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:32.903785 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:32.905499 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:32.969420 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4df440-f3b7-42ae-a554-6f14c129c555 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:32.973805 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:32.974451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:32.974730 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:32.975002 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:32.977200 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:33.048515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:33.049910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:33.061020 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1371/2771] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:40:35.687261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269c7f-37c7-4528-8c80-ce7aaf38c952 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:35.702603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f269c7f-37c7-4528-8c80-ce7aaf38c952 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:35.707152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1c94f-1536-4265-a69d-66d72be466e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:35.707972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1c94f-1536-4265-a69d-66d72be466e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:35.708249 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1c94f-1536-4265-a69d-66d72be466e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:35.708516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1c94f-1536-4265-a69d-66d72be466e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:35.710423 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f3e1c94f-1536-4265-a69d-66d72be466e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:35.724603 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1c94f-1536-4265-a69d-66d72be466e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:35.726065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1c94f-1536-4265-a69d-66d72be466e7 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:35.737225 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1401/2772] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:40:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:40:43.056352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=54 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:45.732094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=6 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:47.999518 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:48.003583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:48.085740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378735c7-4f87-4c5b-9d26-883cfa95b265 service cinder] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:48.090551 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:48.091450 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:48.091705 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:48.091982 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] PATH_INFO: `/v3/users/0cf6852ab4cf4c80a11f9b2d72ab01d1` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:48.093251 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf6852ab4cf4c80a11f9b2d72ab01d1)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:48.095215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:48.158230 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf6852ab4cf4c80a11f9b2d72ab01d1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.158938 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf6852ab4cf4c80a11f9b2d72ab01d1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.159628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf6852ab4cf4c80a11f9b2d72ab01d1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.176368 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf6852ab4cf4c80a11f9b2d72ab01d1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.186790 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-0b05c73a-4dcd-48aa-993a-dad9c2cee149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf6852ab4cf4c80a11f9b2d72ab01d1'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.203461 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1372/2773] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:40:47 2022] DELETE /identity/v3/users/0cf6852ab4cf4c80a11f9b2d72ab01d1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:40:48.615613 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1c94f-1536-4265-a69d-66d72be466e7 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:48.630720 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1c94f-1536-4265-a69d-66d72be466e7 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:48.691197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:48.692116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:48.692398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:48.692673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] PATH_INFO: `/v3/projects/cbeb1391f7ab4de5bf21c0904d082de4` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:48.693983 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbeb1391f7ab4de5bf21c0904d082de4)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:48.695935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:48.755719 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbeb1391f7ab4de5bf21c0904d082de4', 'request_id': 'req-45932446-773c-43db-ba6d-6d4fe913159e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.761597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbeb1391f7ab4de5bf21c0904d082de4', 'request_id': 'req-45932446-773c-43db-ba6d-6d4fe913159e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.773155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbeb1391f7ab4de5bf21c0904d082de4', 'request_id': 'req-45932446-773c-43db-ba6d-6d4fe913159e'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.785058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] The token cache is being invalidate because project cbeb1391f7ab4de5bf21c0904d082de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:40:48.785346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.785995 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-45932446-773c-43db-ba6d-6d4fe913159e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:48.787582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1402/2774] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:40:48 2022] DELETE /identity/v3/projects/cbeb1391f7ab4de5bf21c0904d082de4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:40:48.792738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c02bd-b3b5-4acd-8424-8ec7837bbea3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:48.793058 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c02bd-b3b5-4acd-8424-8ec7837bbea3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:48.793335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c02bd-b3b5-4acd-8424-8ec7837bbea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:48.811727 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0a5c02bd-b3b5-4acd-8424-8ec7837bbea3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:40:48.813064 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0a5c02bd-b3b5-4acd-8424-8ec7837bbea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:48.876712 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1373/2775] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:40:48.884830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8063-da06-41ae-94bd-9a98110f22a3 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:48.885144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8063-da06-41ae-94bd-9a98110f22a3 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:48.885418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b8063-da06-41ae-94bd-9a98110f22a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:48.905144 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-491b8063-da06-41ae-94bd-9a98110f22a3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:40:48.906379 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-491b8063-da06-41ae-94bd-9a98110f22a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:48.916301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1403/2776] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:40:48.921016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c02bd-b3b5-4acd-8424-8ec7837bbea3 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:48.931440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c02bd-b3b5-4acd-8424-8ec7837bbea3 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:48.937104 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2ce0-053b-49d4-ba16-3ba69acf524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:48.937771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2ce0-053b-49d4-ba16-3ba69acf524f admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:48.938056 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2ce0-053b-49d4-ba16-3ba69acf524f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:48.938330 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2ce0-053b-49d4-ba16-3ba69acf524f admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:48.939065 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2ce0-053b-49d4-ba16-3ba69acf524f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:40:48.939373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2ce0-053b-49d4-ba16-3ba69acf524f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:48.941028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2ce0-053b-49d4-ba16-3ba69acf524f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:48.952924 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1374/2777] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:40:48.957735 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b8063-da06-41ae-94bd-9a98110f22a3 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:48.967969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b8063-da06-41ae-94bd-9a98110f22a3 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:48.973443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830b49e-23a1-4549-86e3-a3d913fe1537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:48.974098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830b49e-23a1-4549-86e3-a3d913fe1537 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:48.974376 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830b49e-23a1-4549-86e3-a3d913fe1537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:48.974664 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830b49e-23a1-4549-86e3-a3d913fe1537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:48.975350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830b49e-23a1-4549-86e3-a3d913fe1537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:48.977337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830b49e-23a1-4549-86e3-a3d913fe1537 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.006259 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1404/2778] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:40:48 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:40:49.010558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2ce0-053b-49d4-ba16-3ba69acf524f admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.020677 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2ce0-053b-49d4-ba16-3ba69acf524f admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.024296 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:49.081026 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991914e-435e-43da-a9de-d1445210f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.081704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991914e-435e-43da-a9de-d1445210f6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.081985 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991914e-435e-43da-a9de-d1445210f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.082257 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991914e-435e-43da-a9de-d1445210f6d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.082965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991914e-435e-43da-a9de-d1445210f6d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.084930 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991914e-435e-43da-a9de-d1445210f6d4 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.108513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1375/2779] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:40:49 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:40:49.112891 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830b49e-23a1-4549-86e3-a3d913fe1537 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.123224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830b49e-23a1-4549-86e3-a3d913fe1537 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.127864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899e1e1-1c97-4a2a-842c-dd4ad1da28b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.128525 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899e1e1-1c97-4a2a-842c-dd4ad1da28b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.128807 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899e1e1-1c97-4a2a-842c-dd4ad1da28b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.129113 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899e1e1-1c97-4a2a-842c-dd4ad1da28b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.129872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899e1e1-1c97-4a2a-842c-dd4ad1da28b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.131503 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899e1e1-1c97-4a2a-842c-dd4ad1da28b6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.142227 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1405/2780] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:40:49.146308 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991914e-435e-43da-a9de-d1445210f6d4 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.157003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991914e-435e-43da-a9de-d1445210f6d4 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.162627 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb71a4-e777-402a-9c05-e8ab61e6ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.163290 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb71a4-e777-402a-9c05-e8ab61e6ffb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.163542 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb71a4-e777-402a-9c05-e8ab61e6ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.163806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb71a4-e777-402a-9c05-e8ab61e6ffb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.164532 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb71a4-e777-402a-9c05-e8ab61e6ffb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.166194 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb71a4-e777-402a-9c05-e8ab61e6ffb7 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.176338 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1376/2781] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:40:49.180466 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899e1e1-1c97-4a2a-842c-dd4ad1da28b6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.190779 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899e1e1-1c97-4a2a-842c-dd4ad1da28b6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.195394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef0130-e47d-4688-8788-90bc88705fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.196272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef0130-e47d-4688-8788-90bc88705fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.196548 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef0130-e47d-4688-8788-90bc88705fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.196823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef0130-e47d-4688-8788-90bc88705fc6 admin admin] PATH_INFO: `/v3/projects/de08ba28d3284132bc4e3f5856a03eec/users/722acc067d604cd1a3149980d331a31c/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.213517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef0130-e47d-4688-8788-90bc88705fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de08ba28d3284132bc4e3f5856a03eec, user_id=722acc067d604cd1a3149980d331a31c, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.216168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef0130-e47d-4688-8788-90bc88705fc6 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.231740 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1406/2782] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:40:49 2022] PUT /identity/v3/projects/de08ba28d3284132bc4e3f5856a03eec/users/722acc067d604cd1a3149980d331a31c/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:40:49.244536 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bc83-2adc-4afa-805d-15a24264b38f None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.244825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bc83-2adc-4afa-805d-15a24264b38f None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.245261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823bc83-2adc-4afa-805d-15a24264b38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.274452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6823bc83-2adc-4afa-805d-15a24264b38f None None] MFA Rules not processed for user `722acc067d604cd1a3149980d331a31c`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:40:49.275746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6823bc83-2adc-4afa-805d-15a24264b38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:49.351284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1377/2783] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:40:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:40:49.352501 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef0130-e47d-4688-8788-90bc88705fc6 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.382920 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:49.416869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef0130-e47d-4688-8788-90bc88705fc6 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.421897 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37fad-7883-483f-91b5-e9fa0c5187a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.422559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37fad-7883-483f-91b5-e9fa0c5187a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.422843 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37fad-7883-483f-91b5-e9fa0c5187a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.423120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb37fad-7883-483f-91b5-e9fa0c5187a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.423802 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb37fad-7883-483f-91b5-e9fa0c5187a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.425751 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb37fad-7883-483f-91b5-e9fa0c5187a9 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.454329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1407/2784] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:40:49 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:40:49.459112 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823bc83-2adc-4afa-805d-15a24264b38f None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.475198 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823bc83-2adc-4afa-805d-15a24264b38f None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.544630 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701012c2-c81d-470f-88ee-82bf48e51f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.545213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701012c2-c81d-470f-88ee-82bf48e51f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.545495 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701012c2-c81d-470f-88ee-82bf48e51f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.545760 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701012c2-c81d-470f-88ee-82bf48e51f5c admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.546487 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701012c2-c81d-470f-88ee-82bf48e51f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.548436 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701012c2-c81d-470f-88ee-82bf48e51f5c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.571213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1378/2785] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:40:49 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:40:49.575362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37fad-7883-483f-91b5-e9fa0c5187a9 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.586509 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb37fad-7883-483f-91b5-e9fa0c5187a9 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.592134 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63894fec-5023-4c07-85d8-1a6896e401ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.592801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894fec-5023-4c07-85d8-1a6896e401ce admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.593116 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894fec-5023-4c07-85d8-1a6896e401ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.593389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63894fec-5023-4c07-85d8-1a6896e401ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.594111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63894fec-5023-4c07-85d8-1a6896e401ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.595726 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63894fec-5023-4c07-85d8-1a6896e401ce admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.607033 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1408/2786] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:40:49.611553 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701012c2-c81d-470f-88ee-82bf48e51f5c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.618099 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:49.622449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701012c2-c81d-470f-88ee-82bf48e51f5c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.629016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d61c-e100-4d72-b3c0-d227d2a18128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.629899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d61c-e100-4d72-b3c0-d227d2a18128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.630182 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d61c-e100-4d72-b3c0-d227d2a18128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.630471 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2d61c-e100-4d72-b3c0-d227d2a18128 admin admin] PATH_INFO: `/v3/projects/cb74682cc61f4ca7a20b4c9604f3a752/users/6f28576c824d4bfeb8f96d531354b633/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.645811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d61c-e100-4d72-b3c0-d227d2a18128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb74682cc61f4ca7a20b4c9604f3a752, user_id=6f28576c824d4bfeb8f96d531354b633, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.648492 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2d61c-e100-4d72-b3c0-d227d2a18128 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.663876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1379/2787] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:40:49 2022] PUT /identity/v3/projects/cb74682cc61f4ca7a20b4c9604f3a752/users/6f28576c824d4bfeb8f96d531354b633/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:40:49.668034 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63894fec-5023-4c07-85d8-1a6896e401ce admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.678255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63894fec-5023-4c07-85d8-1a6896e401ce admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.737683 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f07e22-d5ff-4db4-bb0b-8173c21b553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.738352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f07e22-d5ff-4db4-bb0b-8173c21b553b admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.738637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f07e22-d5ff-4db4-bb0b-8173c21b553b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.738955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f07e22-d5ff-4db4-bb0b-8173c21b553b admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.739678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f07e22-d5ff-4db4-bb0b-8173c21b553b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.741334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f07e22-d5ff-4db4-bb0b-8173c21b553b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.752145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1409/2788] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:40:49.757878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d61c-e100-4d72-b3c0-d227d2a18128 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.768511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2d61c-e100-4d72-b3c0-d227d2a18128 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.773382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3fa2c-4d08-43ab-b035-58a2d04c5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.774267 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3fa2c-4d08-43ab-b035-58a2d04c5957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.774561 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3fa2c-4d08-43ab-b035-58a2d04c5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.774836 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3fa2c-4d08-43ab-b035-58a2d04c5957 admin admin] PATH_INFO: `/v3/projects/cb74682cc61f4ca7a20b4c9604f3a752/users/6f28576c824d4bfeb8f96d531354b633/roles/842af9e8967047df873d061df391e820` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.776815 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3fa2c-4d08-43ab-b035-58a2d04c5957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb74682cc61f4ca7a20b4c9604f3a752, user_id=6f28576c824d4bfeb8f96d531354b633, role_id=842af9e8967047df873d061df391e820)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:49.779516 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3fa2c-4d08-43ab-b035-58a2d04c5957 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:49.789854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1380/2789] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:40:49 2022] PUT /identity/v3/projects/cb74682cc61f4ca7a20b4c9604f3a752/users/6f28576c824d4bfeb8f96d531354b633/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:40:49.800212 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c91d-a403-445a-8414-ebca447be143 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.800467 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c91d-a403-445a-8414-ebca447be143 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.800747 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8c91d-a403-445a-8414-ebca447be143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.833384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-6aa8c91d-a403-445a-8414-ebca447be143 None None] MFA Rules not processed for user `6f28576c824d4bfeb8f96d531354b633`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:40:49.835522 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-6aa8c91d-a403-445a-8414-ebca447be143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:49.909535 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1410/2790] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:40:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:40:49.921470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3fa2c-4d08-43ab-b035-58a2d04c5957 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:49.923430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c8f3fa2c-4d08-43ab-b035-58a2d04c5957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:49.984306 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3fa2c-4d08-43ab-b035-58a2d04c5957 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:49.988125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5631b1-baa7-4d22-bbf7-0d99ef0637d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:49.988773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5631b1-baa7-4d22-bbf7-0d99ef0637d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:49.989087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5631b1-baa7-4d22-bbf7-0d99ef0637d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:49.989359 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5631b1-baa7-4d22-bbf7-0d99ef0637d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:49.998933 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5631b1-baa7-4d22-bbf7-0d99ef0637d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:50.000390 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5631b1-baa7-4d22-bbf7-0d99ef0637d6 service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:50.010460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1381/2791] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:40:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:40:50.436533 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8c91d-a403-445a-8414-ebca447be143 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:50.461997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:50.506821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8c91d-a403-445a-8414-ebca447be143 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:50.513000 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:50.513882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:50.514160 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:50.514430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] PATH_INFO: `/v3/users/722acc067d604cd1a3149980d331a31c` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:50.515748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] RBAC: Authorizing `identity:delete_user(user_id=722acc067d604cd1a3149980d331a31c)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:50.517761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:50.569208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722acc067d604cd1a3149980d331a31c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:50.569775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722acc067d604cd1a3149980d331a31c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:50.579287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722acc067d604cd1a3149980d331a31c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:50.587827 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722acc067d604cd1a3149980d331a31c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:50.588500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722acc067d604cd1a3149980d331a31c'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:50.608791 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1411/2792] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:40:50 2022] DELETE /identity/v3/users/722acc067d604cd1a3149980d331a31c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:40:50.613698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da876-6707-432a-8a28-6540bf3d640a None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:50.614188 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da876-6707-432a-8a28-6540bf3d640a None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:50.614303 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da876-6707-432a-8a28-6540bf3d640a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:50.633831 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-518da876-6707-432a-8a28-6540bf3d640a None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:40:50.635068 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-518da876-6707-432a-8a28-6540bf3d640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:50.697604 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1382/2793] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:40:50.707907 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:50.709481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:50.771988 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1fca-d340-4281-929e-f8d76277082b admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:50.776541 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271bd99-603c-4437-baad-37300520fe8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:50.777252 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271bd99-603c-4437-baad-37300520fe8b service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:50.777536 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271bd99-603c-4437-baad-37300520fe8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:50.777814 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271bd99-603c-4437-baad-37300520fe8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:50.787279 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271bd99-603c-4437-baad-37300520fe8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:50.788743 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271bd99-603c-4437-baad-37300520fe8b service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:50.798870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1412/2794] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:40:51.073417 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da876-6707-432a-8a28-6540bf3d640a None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:51.074942 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-518da876-6707-432a-8a28-6540bf3d640a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:51.087850 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518da876-6707-432a-8a28-6540bf3d640a None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:51.093304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:51.094214 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:51.094496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:51.094773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] PATH_INFO: `/v3/projects/de08ba28d3284132bc4e3f5856a03eec` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:51.096659 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de08ba28d3284132bc4e3f5856a03eec)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:51.098664 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:51.151457 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de08ba28d3284132bc4e3f5856a03eec', 'request_id': 'req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.161166 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de08ba28d3284132bc4e3f5856a03eec', 'request_id': 'req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.172023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de08ba28d3284132bc4e3f5856a03eec', 'request_id': 'req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.173371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:51.186541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] The token cache is being invalidate because project de08ba28d3284132bc4e3f5856a03eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:40:51.186828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.187476 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.189096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1383/2795] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:40:51 2022] DELETE /identity/v3/projects/de08ba28d3284132bc4e3f5856a03eec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:40:51.193390 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271bd99-603c-4437-baad-37300520fe8b service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:51.203721 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271bd99-603c-4437-baad-37300520fe8b service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:51.250529 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:51.267688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:51.268569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:51.268872 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:51.269148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] PATH_INFO: `/v3/users/6f28576c824d4bfeb8f96d531354b633` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:51.270558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f28576c824d4bfeb8f96d531354b633)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:51.272575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:51.324041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f28576c824d4bfeb8f96d531354b633'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.324694 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f28576c824d4bfeb8f96d531354b633'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.333391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f28576c824d4bfeb8f96d531354b633'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.340416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f28576c824d4bfeb8f96d531354b633'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.341071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-82eec27f-2d58-4c3f-b35f-a44cb392851a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f28576c824d4bfeb8f96d531354b633'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.359147 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1413/2796] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:40:51 2022] DELETE /identity/v3/users/6f28576c824d4bfeb8f96d531354b633 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:40:51.671177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:51.672696 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:51.686891 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e1f10-8e1b-4a20-8f09-e7502172ce0b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:51.747766 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:51.748645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:51.748957 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:51.749233 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] PATH_INFO: `/v3/projects/cb74682cc61f4ca7a20b4c9604f3a752` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:51.751141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb74682cc61f4ca7a20b4c9604f3a752)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:51.753134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:51.806972 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb74682cc61f4ca7a20b4c9604f3a752', 'request_id': 'req-34d80057-5777-4f9f-9b72-3d14db161ecd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.813328 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb74682cc61f4ca7a20b4c9604f3a752', 'request_id': 'req-34d80057-5777-4f9f-9b72-3d14db161ecd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.822204 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb74682cc61f4ca7a20b4c9604f3a752', 'request_id': 'req-34d80057-5777-4f9f-9b72-3d14db161ecd'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.833900 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] The token cache is being invalidate because project cb74682cc61f4ca7a20b4c9604f3a752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:40:51.834187 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.834844 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-34d80057-5777-4f9f-9b72-3d14db161ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:40:51.836403 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1384/2797] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:40:51 2022] DELETE /identity/v3/projects/cb74682cc61f4ca7a20b4c9604f3a752 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:40:51.841417 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ca9d3-4059-4b24-bac0-a0ba1db853eb None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:51.841894 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ca9d3-4059-4b24-bac0-a0ba1db853eb None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:51.841991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ca9d3-4059-4b24-bac0-a0ba1db853eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:51.859543 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2d6ca9d3-4059-4b24-bac0-a0ba1db853eb None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:40:51.860755 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2d6ca9d3-4059-4b24-bac0-a0ba1db853eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:51.928787 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1414/2798] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:40:51.942638 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efa5bd-6f45-4aed-b7b3-71279c7f49b4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:51.942945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efa5bd-6f45-4aed-b7b3-71279c7f49b4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:51.943283 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efa5bd-6f45-4aed-b7b3-71279c7f49b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:51.963788 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-85efa5bd-6f45-4aed-b7b3-71279c7f49b4 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:40:51.965018 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-85efa5bd-6f45-4aed-b7b3-71279c7f49b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:51.973286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1385/2799] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:40:51.977637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ca9d3-4059-4b24-bac0-a0ba1db853eb None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:51.987558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ca9d3-4059-4b24-bac0-a0ba1db853eb None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:51.992776 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee4af-90f0-4298-9af3-52e46697241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:51.993472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee4af-90f0-4298-9af3-52e46697241c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:51.993826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee4af-90f0-4298-9af3-52e46697241c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:51.994061 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ee4af-90f0-4298-9af3-52e46697241c admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:51.994851 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ee4af-90f0-4298-9af3-52e46697241c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:40:51.995137 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ee4af-90f0-4298-9af3-52e46697241c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:51.996759 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ee4af-90f0-4298-9af3-52e46697241c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.008835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1415/2800] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:40:52.013235 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efa5bd-6f45-4aed-b7b3-71279c7f49b4 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.023070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efa5bd-6f45-4aed-b7b3-71279c7f49b4 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.028651 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0adc8-1734-4382-9c70-ab5dcda9221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.029327 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0adc8-1734-4382-9c70-ab5dcda9221c admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.029628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0adc8-1734-4382-9c70-ab5dcda9221c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.029898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0adc8-1734-4382-9c70-ab5dcda9221c admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.030588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0adc8-1734-4382-9c70-ab5dcda9221c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.032489 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0adc8-1734-4382-9c70-ab5dcda9221c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.070041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1386/2801] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:40:52 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:40:52.076094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee4af-90f0-4298-9af3-52e46697241c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.087813 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ee4af-90f0-4298-9af3-52e46697241c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.140363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:52.152334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42c08d-ff37-4801-8be7-5e17de2de26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.153063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42c08d-ff37-4801-8be7-5e17de2de26c admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.153357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42c08d-ff37-4801-8be7-5e17de2de26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.153636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42c08d-ff37-4801-8be7-5e17de2de26c admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.154346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42c08d-ff37-4801-8be7-5e17de2de26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.156761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42c08d-ff37-4801-8be7-5e17de2de26c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.178558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1416/2802] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:40:52 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:40:52.182847 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0adc8-1734-4382-9c70-ab5dcda9221c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.193175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0adc8-1734-4382-9c70-ab5dcda9221c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.198215 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ae11a-3a79-4774-9d2a-0799f706c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.198886 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ae11a-3a79-4774-9d2a-0799f706c5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.199161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ae11a-3a79-4774-9d2a-0799f706c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.199430 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ae11a-3a79-4774-9d2a-0799f706c5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.200160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ae11a-3a79-4774-9d2a-0799f706c5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.201799 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ae11a-3a79-4774-9d2a-0799f706c5b3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.212827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1387/2803] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:40:52.217112 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42c08d-ff37-4801-8be7-5e17de2de26c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.227647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42c08d-ff37-4801-8be7-5e17de2de26c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.233264 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21169-989e-4a88-9bdb-34bab00af8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.233918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21169-989e-4a88-9bdb-34bab00af8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.234221 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21169-989e-4a88-9bdb-34bab00af8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.234496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21169-989e-4a88-9bdb-34bab00af8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.235214 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c21169-989e-4a88-9bdb-34bab00af8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.236829 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c21169-989e-4a88-9bdb-34bab00af8aa admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.246821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1417/2804] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:40:52.251395 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ae11a-3a79-4774-9d2a-0799f706c5b3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.267336 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ae11a-3a79-4774-9d2a-0799f706c5b3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.275669 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c489c8-4d97-49a1-aec9-7b723e3ef86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.276649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c489c8-4d97-49a1-aec9-7b723e3ef86c admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.276975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c489c8-4d97-49a1-aec9-7b723e3ef86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.277254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c489c8-4d97-49a1-aec9-7b723e3ef86c admin admin] PATH_INFO: `/v3/projects/5b14359a4f1d4595916049d044e87d47/users/b3f4769496f8497ea937813dbfd93a1f/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.296030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c489c8-4d97-49a1-aec9-7b723e3ef86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b14359a4f1d4595916049d044e87d47, user_id=b3f4769496f8497ea937813dbfd93a1f, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.298786 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c489c8-4d97-49a1-aec9-7b723e3ef86c admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.314078 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1388/2805] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:40:52 2022] PUT /identity/v3/projects/5b14359a4f1d4595916049d044e87d47/users/b3f4769496f8497ea937813dbfd93a1f/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:40:52.325343 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b72c1f-c55a-451a-829e-3c9df8d3ed3c None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.325726 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b72c1f-c55a-451a-829e-3c9df8d3ed3c None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.326129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b72c1f-c55a-451a-829e-3c9df8d3ed3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.360707 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-48b72c1f-c55a-451a-829e-3c9df8d3ed3c None None] MFA Rules not processed for user `b3f4769496f8497ea937813dbfd93a1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:40:52.361950 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-48b72c1f-c55a-451a-829e-3c9df8d3ed3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:52.441427 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1418/2806] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:40:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:40:52.446060 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c489c8-4d97-49a1-aec9-7b723e3ef86c admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.469178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:52.514996 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c489c8-4d97-49a1-aec9-7b723e3ef86c admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.520458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8913f-7cb8-49b1-ac43-cd75f9422eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.521164 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8913f-7cb8-49b1-ac43-cd75f9422eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.521449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8913f-7cb8-49b1-ac43-cd75f9422eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.521724 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8913f-7cb8-49b1-ac43-cd75f9422eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.522440 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8913f-7cb8-49b1-ac43-cd75f9422eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.524383 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8913f-7cb8-49b1-ac43-cd75f9422eb8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.551764 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1389/2807] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:40:52 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:40:52.555918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b72c1f-c55a-451a-829e-3c9df8d3ed3c None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.567349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b72c1f-c55a-451a-829e-3c9df8d3ed3c None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.637258 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f2a8-e715-4a3f-95b8-f241710343f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.637935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f2a8-e715-4a3f-95b8-f241710343f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.638220 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f2a8-e715-4a3f-95b8-f241710343f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.638497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f2a8-e715-4a3f-95b8-f241710343f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.639195 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f2a8-e715-4a3f-95b8-f241710343f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.641172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f2a8-e715-4a3f-95b8-f241710343f2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.668834 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1419/2808] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:40:52 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:40:52.672944 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8913f-7cb8-49b1-ac43-cd75f9422eb8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.683410 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8913f-7cb8-49b1-ac43-cd75f9422eb8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.688185 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156a1b-d50b-4548-9edb-8bc2d5d094df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.688876 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156a1b-d50b-4548-9edb-8bc2d5d094df admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.689172 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156a1b-d50b-4548-9edb-8bc2d5d094df admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.689444 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca156a1b-d50b-4548-9edb-8bc2d5d094df admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.690248 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca156a1b-d50b-4548-9edb-8bc2d5d094df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.691842 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca156a1b-d50b-4548-9edb-8bc2d5d094df admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.702369 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1390/2809] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:40:52.706946 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f2a8-e715-4a3f-95b8-f241710343f2 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.717556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f2a8-e715-4a3f-95b8-f241710343f2 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.722399 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404712-8c93-40c3-88bf-388e16f29092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.723283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404712-8c93-40c3-88bf-388e16f29092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.723564 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404712-8c93-40c3-88bf-388e16f29092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.723839 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07404712-8c93-40c3-88bf-388e16f29092 admin admin] PATH_INFO: `/v3/projects/f2063f63d5fb469bae72789da70c0cba/users/cc364649c4ac40d4a7f0b5bfc2fd95b7/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.739197 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404712-8c93-40c3-88bf-388e16f29092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2063f63d5fb469bae72789da70c0cba, user_id=cc364649c4ac40d4a7f0b5bfc2fd95b7, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.741922 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07404712-8c93-40c3-88bf-388e16f29092 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.757301 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1420/2810] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:40:52 2022] PUT /identity/v3/projects/f2063f63d5fb469bae72789da70c0cba/users/cc364649c4ac40d4a7f0b5bfc2fd95b7/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:40:52.761274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156a1b-d50b-4548-9edb-8bc2d5d094df admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.772134 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca156a1b-d50b-4548-9edb-8bc2d5d094df admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.840761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f662db6-80c5-46fb-93ed-38fcffab69d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.841465 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f662db6-80c5-46fb-93ed-38fcffab69d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.841748 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f662db6-80c5-46fb-93ed-38fcffab69d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.842022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f662db6-80c5-46fb-93ed-38fcffab69d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.842753 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f662db6-80c5-46fb-93ed-38fcffab69d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.844373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f662db6-80c5-46fb-93ed-38fcffab69d3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.854929 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1391/2811] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:40:52.859519 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404712-8c93-40c3-88bf-388e16f29092 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:52.874130 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07404712-8c93-40c3-88bf-388e16f29092 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:52.879169 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c779ac-e4db-4d35-b76f-c95a16f39953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:52.880057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c779ac-e4db-4d35-b76f-c95a16f39953 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.880334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c779ac-e4db-4d35-b76f-c95a16f39953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.880589 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c779ac-e4db-4d35-b76f-c95a16f39953 admin admin] PATH_INFO: `/v3/projects/f2063f63d5fb469bae72789da70c0cba/users/cc364649c4ac40d4a7f0b5bfc2fd95b7/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.882676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c779ac-e4db-4d35-b76f-c95a16f39953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2063f63d5fb469bae72789da70c0cba, user_id=cc364649c4ac40d4a7f0b5bfc2fd95b7, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:52.885402 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c779ac-e4db-4d35-b76f-c95a16f39953 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:52.896128 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1421/2812] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:40:52 2022] PUT /identity/v3/projects/f2063f63d5fb469bae72789da70c0cba/users/cc364649c4ac40d4a7f0b5bfc2fd95b7/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:40:52.906545 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87e1f-e0cc-487b-949a-66b48a276e87 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:52.906839 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87e1f-e0cc-487b-949a-66b48a276e87 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:52.907119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e87e1f-e0cc-487b-949a-66b48a276e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:52.934882 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-d7e87e1f-e0cc-487b-949a-66b48a276e87 None None] MFA Rules not processed for user `cc364649c4ac40d4a7f0b5bfc2fd95b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:40:52.936130 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-d7e87e1f-e0cc-487b-949a-66b48a276e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:53.007054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1392/2813] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:40:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:40:53.018819 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c779ac-e4db-4d35-b76f-c95a16f39953 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:53.020990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-90c779ac-e4db-4d35-b76f-c95a16f39953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:40:53.035599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:53.082031 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c779ac-e4db-4d35-b76f-c95a16f39953 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:53.086084 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042c853-56f0-43b1-90de-f518df7104a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:53.086734 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042c853-56f0-43b1-90de-f518df7104a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:53.087011 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042c853-56f0-43b1-90de-f518df7104a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:53.087286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042c853-56f0-43b1-90de-f518df7104a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:53.096869 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042c853-56f0-43b1-90de-f518df7104a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:53.098337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042c853-56f0-43b1-90de-f518df7104a6 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:53.108416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1422/2814] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:40:53 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:40:53.183408 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87e1f-e0cc-487b-949a-66b48a276e87 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:40:53.194555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e87e1f-e0cc-487b-949a-66b48a276e87 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:40:53.199043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4dcbe-9b5e-4aa0-9daa-5a19461af76c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:40:53.199699 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4dcbe-9b5e-4aa0-9daa-5a19461af76c service cinder] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:40:53.199978 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4dcbe-9b5e-4aa0-9daa-5a19461af76c service cinder] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:40:53.200254 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4dcbe-9b5e-4aa0-9daa-5a19461af76c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:40:53.216452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:40:53.267005 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4dcbe-9b5e-4aa0-9daa-5a19461af76c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:40:53.268463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4dcbe-9b5e-4aa0-9daa-5a19461af76c service cinder] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:40:53.278080 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1393/2815] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:40:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:00.377359 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042c853-56f0-43b1-90de-f518df7104a6 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:00.439389 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042c853-56f0-43b1-90de-f518df7104a6 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:00.444889 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:00.445782 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:00.446063 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:00.446337 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] PATH_INFO: `/v3/users/b3f4769496f8497ea937813dbfd93a1f` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:00.447634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f4769496f8497ea937813dbfd93a1f)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:00.449616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:00.507042 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f4769496f8497ea937813dbfd93a1f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:00.507625 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f4769496f8497ea937813dbfd93a1f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:00.516553 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f4769496f8497ea937813dbfd93a1f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:00.523692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f4769496f8497ea937813dbfd93a1f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:00.524356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f4769496f8497ea937813dbfd93a1f'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:00.541478 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1423/2816] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:41:00 2022] DELETE /identity/v3/users/b3f4769496f8497ea937813dbfd93a1f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:00.546425 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0490fc8-9c78-4437-8217-06ba74f35799 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:00.546966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0490fc8-9c78-4437-8217-06ba74f35799 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:00.546966 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0490fc8-9c78-4437-8217-06ba74f35799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:00.564977 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-a0490fc8-9c78-4437-8217-06ba74f35799 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:00.566191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0490fc8-9c78-4437-8217-06ba74f35799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:00.640394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1394/2817] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:41:00.651459 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:00.653424 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:00.690935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:00.714856 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca5360-ead7-4912-ad98-aa52bb03ec3c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:00.718722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee908f36-fb20-43c4-8f3f-f3807c625c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:00.719372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee908f36-fb20-43c4-8f3f-f3807c625c5a service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:00.719654 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee908f36-fb20-43c4-8f3f-f3807c625c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:00.719931 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee908f36-fb20-43c4-8f3f-f3807c625c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:00.728883 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee908f36-fb20-43c4-8f3f-f3807c625c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:00.730362 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee908f36-fb20-43c4-8f3f-f3807c625c5a service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:00.739835 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1424/2818] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:01.036452 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0490fc8-9c78-4437-8217-06ba74f35799 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:01.038003 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-a0490fc8-9c78-4437-8217-06ba74f35799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:01.055229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0490fc8-9c78-4437-8217-06ba74f35799 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:01.061154 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:01.061821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:01.062209 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:01.062326 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] PATH_INFO: `/v3/projects/5b14359a4f1d4595916049d044e87d47` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:01.063660 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b14359a4f1d4595916049d044e87d47)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:01.065636 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:01.130119 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b14359a4f1d4595916049d044e87d47', 'request_id': 'req-939f476b-01df-4e13-a3a2-ab5560ae230b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.135892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b14359a4f1d4595916049d044e87d47', 'request_id': 'req-939f476b-01df-4e13-a3a2-ab5560ae230b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.144709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b14359a4f1d4595916049d044e87d47', 'request_id': 'req-939f476b-01df-4e13-a3a2-ab5560ae230b'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.156095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] The token cache is being invalidate because project 5b14359a4f1d4595916049d044e87d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:41:01.156378 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.157085 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.158655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1395/2819] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:41:01 2022] DELETE /identity/v3/projects/5b14359a4f1d4595916049d044e87d47 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:01.162809 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee908f36-fb20-43c4-8f3f-f3807c625c5a service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:01.172223 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee908f36-fb20-43c4-8f3f-f3807c625c5a service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:01.231928 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:01.232933 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:01.233237 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:01.233511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] PATH_INFO: `/v3/users/cc364649c4ac40d4a7f0b5bfc2fd95b7` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:01.234758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc364649c4ac40d4a7f0b5bfc2fd95b7)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:01.236767 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:01.291974 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc364649c4ac40d4a7f0b5bfc2fd95b7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.292549 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc364649c4ac40d4a7f0b5bfc2fd95b7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.300874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc364649c4ac40d4a7f0b5bfc2fd95b7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.308384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc364649c4ac40d4a7f0b5bfc2fd95b7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.309142 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-5abeec57-3cdc-4a71-9b73-2c76a716cf3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc364649c4ac40d4a7f0b5bfc2fd95b7'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.329231 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1425/2820] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:41:01 2022] DELETE /identity/v3/users/cc364649c4ac40d4a7f0b5bfc2fd95b7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:01.614511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:01.616051 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:01.629531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f476b-01df-4e13-a3a2-ab5560ae230b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:01.670628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:01.696795 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:01.697703 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:01.697983 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:01.698264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] PATH_INFO: `/v3/projects/f2063f63d5fb469bae72789da70c0cba` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:01.699447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2063f63d5fb469bae72789da70c0cba)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:01.701594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:01.759914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2063f63d5fb469bae72789da70c0cba', 'request_id': 'req-fd2c1169-0903-49ce-b601-288d17a9125f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.766070 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2063f63d5fb469bae72789da70c0cba', 'request_id': 'req-fd2c1169-0903-49ce-b601-288d17a9125f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.776052 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2063f63d5fb469bae72789da70c0cba', 'request_id': 'req-fd2c1169-0903-49ce-b601-288d17a9125f'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.788271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] The token cache is being invalidate because project f2063f63d5fb469bae72789da70c0cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:41:01.788550 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.789239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-fd2c1169-0903-49ce-b601-288d17a9125f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:01.790870 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1396/2821] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:41:01 2022] DELETE /identity/v3/projects/f2063f63d5fb469bae72789da70c0cba => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:01.795906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31920a-ae7c-47d5-ba6b-87d9ba1279c1 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:01.796415 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31920a-ae7c-47d5-ba6b-87d9ba1279c1 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:01.796517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31920a-ae7c-47d5-ba6b-87d9ba1279c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:01.815210 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-fa31920a-ae7c-47d5-ba6b-87d9ba1279c1 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:01.816335 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-fa31920a-ae7c-47d5-ba6b-87d9ba1279c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:01.870612 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:01.885633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1426/2822] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:01.893640 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4a214-7bed-4771-a571-91442d5b0352 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:01.893925 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4a214-7bed-4771-a571-91442d5b0352 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:01.894210 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4a214-7bed-4771-a571-91442d5b0352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:01.913800 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-68f4a214-7bed-4771-a571-91442d5b0352 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:01.915022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-68f4a214-7bed-4771-a571-91442d5b0352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:01.924175 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1397/2823] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:01.928418 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31920a-ae7c-47d5-ba6b-87d9ba1279c1 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:01.938356 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31920a-ae7c-47d5-ba6b-87d9ba1279c1 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:01.943626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63b3b-5775-4918-83b3-13b92de7eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:01.944289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63b3b-5775-4918-83b3-13b92de7eeaf admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:01.944575 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63b3b-5775-4918-83b3-13b92de7eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:01.944905 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63b3b-5775-4918-83b3-13b92de7eeaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:01.945635 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b63b3b-5775-4918-83b3-13b92de7eeaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:41:01.945945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b63b3b-5775-4918-83b3-13b92de7eeaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:01.947552 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b63b3b-5775-4918-83b3-13b92de7eeaf admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:01.959506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1427/2824] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:41:01.964024 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4a214-7bed-4771-a571-91442d5b0352 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:01.975178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4a214-7bed-4771-a571-91442d5b0352 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:01.982168 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d2c2-03ae-4bae-b0e7-920c64f118f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:01.982832 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d2c2-03ae-4bae-b0e7-920c64f118f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:01.983111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d2c2-03ae-4bae-b0e7-920c64f118f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:01.983384 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d2c2-03ae-4bae-b0e7-920c64f118f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:01.984088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d2c2-03ae-4bae-b0e7-920c64f118f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:01.986091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d2c2-03ae-4bae-b0e7-920c64f118f2 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.023908 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1398/2825] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:41:01 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:41:02.030121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63b3b-5775-4918-83b3-13b92de7eeaf admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.044972 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63b3b-5775-4918-83b3-13b92de7eeaf admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.110083 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5fec1-1a87-4267-aefd-303e7f5dc0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.110757 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5fec1-1a87-4267-aefd-303e7f5dc0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.111043 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5fec1-1a87-4267-aefd-303e7f5dc0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.111320 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5fec1-1a87-4267-aefd-303e7f5dc0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.112007 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5fec1-1a87-4267-aefd-303e7f5dc0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.113999 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5fec1-1a87-4267-aefd-303e7f5dc0f0 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.135462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1428/2826] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:41:02 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:41:02.139899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d2c2-03ae-4bae-b0e7-920c64f118f2 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.150244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d2c2-03ae-4bae-b0e7-920c64f118f2 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.155387 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd506d1-0147-4338-9d31-a5310b6e8f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.158089 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd506d1-0147-4338-9d31-a5310b6e8f99 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.158567 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd506d1-0147-4338-9d31-a5310b6e8f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.158904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd506d1-0147-4338-9d31-a5310b6e8f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.160221 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd506d1-0147-4338-9d31-a5310b6e8f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.168526 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd506d1-0147-4338-9d31-a5310b6e8f99 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.180258 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1399/2827] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:41:02.185586 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5fec1-1a87-4267-aefd-303e7f5dc0f0 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.198769 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5fec1-1a87-4267-aefd-303e7f5dc0f0 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.205493 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408ef55-823c-4916-8d4b-9cd269d2d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.206209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408ef55-823c-4916-8d4b-9cd269d2d656 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.206492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408ef55-823c-4916-8d4b-9cd269d2d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.206775 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408ef55-823c-4916-8d4b-9cd269d2d656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.207500 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408ef55-823c-4916-8d4b-9cd269d2d656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.209168 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408ef55-823c-4916-8d4b-9cd269d2d656 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.220725 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1429/2828] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:41:02.226910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd506d1-0147-4338-9d31-a5310b6e8f99 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.239329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd506d1-0147-4338-9d31-a5310b6e8f99 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.244962 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14de72-5919-4271-a449-f8af7bffe759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.245855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14de72-5919-4271-a449-f8af7bffe759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.246133 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14de72-5919-4271-a449-f8af7bffe759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.246415 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14de72-5919-4271-a449-f8af7bffe759 admin admin] PATH_INFO: `/v3/projects/72a54dc9555f4ec3bbe7a507068ab18a/users/0ba8c9e96e4d427d906e404d07647aae/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.261382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14de72-5919-4271-a449-f8af7bffe759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a54dc9555f4ec3bbe7a507068ab18a, user_id=0ba8c9e96e4d427d906e404d07647aae, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.264147 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14de72-5919-4271-a449-f8af7bffe759 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.281256 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1400/2829] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:41:02 2022] PUT /identity/v3/projects/72a54dc9555f4ec3bbe7a507068ab18a/users/0ba8c9e96e4d427d906e404d07647aae/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:02.291856 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835423b0-a9f1-45a1-83d0-c3eed114d818 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.292145 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835423b0-a9f1-45a1-83d0-c3eed114d818 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.292428 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835423b0-a9f1-45a1-83d0-c3eed114d818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.320132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-835423b0-a9f1-45a1-83d0-c3eed114d818 None None] MFA Rules not processed for user `0ba8c9e96e4d427d906e404d07647aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:02.321442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-835423b0-a9f1-45a1-83d0-c3eed114d818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:02.388750 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1430/2830] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:02.395451 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14de72-5919-4271-a449-f8af7bffe759 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.466939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14de72-5919-4271-a449-f8af7bffe759 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.472512 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdff2e-9d34-4468-b833-ca7bd6c8b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.473348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdff2e-9d34-4468-b833-ca7bd6c8b98a admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.473626 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdff2e-9d34-4468-b833-ca7bd6c8b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.473907 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdff2e-9d34-4468-b833-ca7bd6c8b98a admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.474594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdff2e-9d34-4468-b833-ca7bd6c8b98a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.476522 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdff2e-9d34-4468-b833-ca7bd6c8b98a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.484881 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:02.506601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1401/2831] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:41:02 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:41:02.510968 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835423b0-a9f1-45a1-83d0-c3eed114d818 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.522177 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835423b0-a9f1-45a1-83d0-c3eed114d818 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.570073 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:02.582690 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d5fb-3461-432c-a626-36517efe61d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.583372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d5fb-3461-432c-a626-36517efe61d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.583656 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d5fb-3461-432c-a626-36517efe61d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.583936 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879d5fb-3461-432c-a626-36517efe61d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.584636 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879d5fb-3461-432c-a626-36517efe61d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.586659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879d5fb-3461-432c-a626-36517efe61d4 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.608283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1431/2832] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:41:02 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:41:02.612502 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdff2e-9d34-4468-b833-ca7bd6c8b98a admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.622984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdff2e-9d34-4468-b833-ca7bd6c8b98a admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.628156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb8c8f-f3dc-4f0d-97a1-7c272bae8ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.628827 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb8c8f-f3dc-4f0d-97a1-7c272bae8ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.629167 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb8c8f-f3dc-4f0d-97a1-7c272bae8ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.629447 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb8c8f-f3dc-4f0d-97a1-7c272bae8ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.630181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb8c8f-f3dc-4f0d-97a1-7c272bae8ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.631811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb8c8f-f3dc-4f0d-97a1-7c272bae8ae3 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.642759 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1402/2833] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:41:02.646994 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d5fb-3461-432c-a626-36517efe61d4 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.658022 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879d5fb-3461-432c-a626-36517efe61d4 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.664662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df40bb-517c-4834-8a29-28f5607bae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.665878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df40bb-517c-4834-8a29-28f5607bae2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.666163 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df40bb-517c-4834-8a29-28f5607bae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.666441 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df40bb-517c-4834-8a29-28f5607bae2f admin admin] PATH_INFO: `/v3/projects/42d860f1c6d5412ea1b0ab64535988b7/users/2e6d645aa2a746abb637772c1683f61a/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.681854 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df40bb-517c-4834-8a29-28f5607bae2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d860f1c6d5412ea1b0ab64535988b7, user_id=2e6d645aa2a746abb637772c1683f61a, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.684568 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df40bb-517c-4834-8a29-28f5607bae2f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.700300 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1432/2834] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:41:02 2022] PUT /identity/v3/projects/42d860f1c6d5412ea1b0ab64535988b7/users/2e6d645aa2a746abb637772c1683f61a/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:02.704825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb8c8f-f3dc-4f0d-97a1-7c272bae8ae3 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.714855 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb8c8f-f3dc-4f0d-97a1-7c272bae8ae3 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.772252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f532-b4b2-4a62-93c2-550f282adc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.772965 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f532-b4b2-4a62-93c2-550f282adc80 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.773239 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f532-b4b2-4a62-93c2-550f282adc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.773517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f532-b4b2-4a62-93c2-550f282adc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.774253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f532-b4b2-4a62-93c2-550f282adc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.775880 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f532-b4b2-4a62-93c2-550f282adc80 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.785697 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1403/2835] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:41:02.789977 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df40bb-517c-4834-8a29-28f5607bae2f admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:02.800468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df40bb-517c-4834-8a29-28f5607bae2f admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:02.805173 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55e97-395c-4c2e-82be-9065f44a31ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:02.806066 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55e97-395c-4c2e-82be-9065f44a31ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.806382 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55e97-395c-4c2e-82be-9065f44a31ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.806659 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa55e97-395c-4c2e-82be-9065f44a31ef admin admin] PATH_INFO: `/v3/projects/42d860f1c6d5412ea1b0ab64535988b7/users/2e6d645aa2a746abb637772c1683f61a/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.808761 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa55e97-395c-4c2e-82be-9065f44a31ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d860f1c6d5412ea1b0ab64535988b7, user_id=2e6d645aa2a746abb637772c1683f61a, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:02.811507 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa55e97-395c-4c2e-82be-9065f44a31ef admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:02.822505 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1433/2836] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:41:02 2022] PUT /identity/v3/projects/42d860f1c6d5412ea1b0ab64535988b7/users/2e6d645aa2a746abb637772c1683f61a/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:02.888049 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a7dc-66eb-4823-a213-e86374f73ee2 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:02.888555 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a7dc-66eb-4823-a213-e86374f73ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:02.889015 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843a7dc-66eb-4823-a213-e86374f73ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:02.918264 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-e843a7dc-66eb-4823-a213-e86374f73ee2 None None] MFA Rules not processed for user `2e6d645aa2a746abb637772c1683f61a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:02.919541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-e843a7dc-66eb-4823-a213-e86374f73ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:02.991702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1404/2837] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:03.003633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55e97-395c-4c2e-82be-9065f44a31ef admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:03.005447 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-7fa55e97-395c-4c2e-82be-9065f44a31ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:03.066616 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa55e97-395c-4c2e-82be-9065f44a31ef admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:03.070408 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5abf49-b136-4ac0-8a7c-fca0f8d58e8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:03.071067 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5abf49-b136-4ac0-8a7c-fca0f8d58e8a service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:03.071354 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5abf49-b136-4ac0-8a7c-fca0f8d58e8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:03.071642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5abf49-b136-4ac0-8a7c-fca0f8d58e8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:03.081443 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5abf49-b136-4ac0-8a7c-fca0f8d58e8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:03.082911 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5abf49-b136-4ac0-8a7c-fca0f8d58e8a service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:03.092562 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1434/2838] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 01 16:41:03.159463 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843a7dc-66eb-4823-a213-e86374f73ee2 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:03.221304 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843a7dc-66eb-4823-a213-e86374f73ee2 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:03.226365 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:03.227261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:03.227541 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:03.227816 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] PATH_INFO: `/v3/users/0ba8c9e96e4d427d906e404d07647aae` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:03.229127 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba8c9e96e4d427d906e404d07647aae)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:03.231103 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:03.232721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:03.283156 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba8c9e96e4d427d906e404d07647aae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.283808 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba8c9e96e4d427d906e404d07647aae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.284428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba8c9e96e4d427d906e404d07647aae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.296043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba8c9e96e4d427d906e404d07647aae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.302734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba8c9e96e4d427d906e404d07647aae'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.317460 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1405/2839] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:41:03 2022] DELETE /identity/v3/users/0ba8c9e96e4d427d906e404d07647aae => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:03.322314 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fd962-590b-4fdf-91fc-fa49d0464bb8 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:03.322678 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fd962-590b-4fdf-91fc-fa49d0464bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:03.322929 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312fd962-590b-4fdf-91fc-fa49d0464bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:03.341102 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-312fd962-590b-4fdf-91fc-fa49d0464bb8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:03.342384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-312fd962-590b-4fdf-91fc-fa49d0464bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:03.401860 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1435/2840] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:03.411771 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:03.413340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:03.473286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f2de0-eed5-429c-82b4-d0e39e5ab009 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:03.477949 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b78f-4e03-4b8a-aad5-df33cf1a59b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:03.478594 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b78f-4e03-4b8a-aad5-df33cf1a59b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:03.478875 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b78f-4e03-4b8a-aad5-df33cf1a59b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:03.479142 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b78f-4e03-4b8a-aad5-df33cf1a59b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:03.490344 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b78f-4e03-4b8a-aad5-df33cf1a59b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:03.491792 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b78f-4e03-4b8a-aad5-df33cf1a59b8 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:03.501898 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1406/2841] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:03.776174 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fd962-590b-4fdf-91fc-fa49d0464bb8 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:03.777699 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-312fd962-590b-4fdf-91fc-fa49d0464bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:03.789914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312fd962-590b-4fdf-91fc-fa49d0464bb8 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:03.794786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:03.795661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:03.795940 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:03.796218 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] PATH_INFO: `/v3/projects/72a54dc9555f4ec3bbe7a507068ab18a` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:03.797432 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a54dc9555f4ec3bbe7a507068ab18a)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:03.799517 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:03.843129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:03.850296 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a54dc9555f4ec3bbe7a507068ab18a', 'request_id': 'req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.856689 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a54dc9555f4ec3bbe7a507068ab18a', 'request_id': 'req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.865076 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a54dc9555f4ec3bbe7a507068ab18a', 'request_id': 'req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.878270 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] The token cache is being invalidate because project 72a54dc9555f4ec3bbe7a507068ab18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:41:03.878629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.879676 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:03.882446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1436/2842] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:41:03 2022] DELETE /identity/v3/projects/72a54dc9555f4ec3bbe7a507068ab18a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:03.886478 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b78f-4e03-4b8a-aad5-df33cf1a59b8 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:03.896770 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b78f-4e03-4b8a-aad5-df33cf1a59b8 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:03.956123 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:03.957044 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:03.957325 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:03.957601 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] PATH_INFO: `/v3/users/2e6d645aa2a746abb637772c1683f61a` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:03.958801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6d645aa2a746abb637772c1683f61a)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:03.960742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:03.983115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:04.012107 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6d645aa2a746abb637772c1683f61a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.012692 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6d645aa2a746abb637772c1683f61a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.013416 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6d645aa2a746abb637772c1683f61a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.025980 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6d645aa2a746abb637772c1683f61a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.033299 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-7117b033-c568-4f78-85f8-9a0fdf0314fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6d645aa2a746abb637772c1683f61a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.048202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1407/2843] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:41:03 2022] DELETE /identity/v3/users/2e6d645aa2a746abb637772c1683f61a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:04.334587 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:04.336152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:04.352574 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a53c00-b574-4b3c-bd2b-7d9abe6b5b5a admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:04.409917 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:04.410800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.411082 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.411350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] PATH_INFO: `/v3/projects/42d860f1c6d5412ea1b0ab64535988b7` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:04.412523 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d860f1c6d5412ea1b0ab64535988b7)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:04.414492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:04.462508 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d860f1c6d5412ea1b0ab64535988b7', 'request_id': 'req-38333490-1ed7-46a0-a813-1d0579073065'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.468282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d860f1c6d5412ea1b0ab64535988b7', 'request_id': 'req-38333490-1ed7-46a0-a813-1d0579073065'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.478001 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d860f1c6d5412ea1b0ab64535988b7', 'request_id': 'req-38333490-1ed7-46a0-a813-1d0579073065'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.489484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] The token cache is being invalidate because project 42d860f1c6d5412ea1b0ab64535988b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80130) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:41:04.489763 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.490386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-38333490-1ed7-46a0-a813-1d0579073065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:41:04.491941 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1437/2844] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:41:04 2022] DELETE /identity/v3/projects/42d860f1c6d5412ea1b0ab64535988b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:41:04.499576 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592766e0-5812-4c95-85bf-40ae8f1a5064 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.499873 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592766e0-5812-4c95-85bf-40ae8f1a5064 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.500149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592766e0-5812-4c95-85bf-40ae8f1a5064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:04.518647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-592766e0-5812-4c95-85bf-40ae8f1a5064 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:04.519843 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-592766e0-5812-4c95-85bf-40ae8f1a5064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:04.581797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1408/2845] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:04.590521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26aeb3-7d9f-4b3d-8339-703e36977827 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.590906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26aeb3-7d9f-4b3d-8339-703e36977827 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.591292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26aeb3-7d9f-4b3d-8339-703e36977827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:04.617026 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-da26aeb3-7d9f-4b3d-8339-703e36977827 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:04.618255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-da26aeb3-7d9f-4b3d-8339-703e36977827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:04.627753 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1438/2846] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:04.632055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592766e0-5812-4c95-85bf-40ae8f1a5064 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:04.647807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592766e0-5812-4c95-85bf-40ae8f1a5064 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:04.655343 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ecd77-c1a4-4ec3-b1fb-c31d54f9efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:04.656259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ecd77-c1a4-4ec3-b1fb-c31d54f9efc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.656657 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ecd77-c1a4-4ec3-b1fb-c31d54f9efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.657116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ecd77-c1a4-4ec3-b1fb-c31d54f9efc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:04.657956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ecd77-c1a4-4ec3-b1fb-c31d54f9efc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80131) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:41:04.658283 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ecd77-c1a4-4ec3-b1fb-c31d54f9efc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:04.660723 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ecd77-c1a4-4ec3-b1fb-c31d54f9efc1 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:04.676761 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1409/2847] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:41:04.681391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26aeb3-7d9f-4b3d-8339-703e36977827 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:04.691229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26aeb3-7d9f-4b3d-8339-703e36977827 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:04.697167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72e9ea-2e57-465e-89e8-896571f16190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:04.697821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72e9ea-2e57-465e-89e8-896571f16190 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.698094 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72e9ea-2e57-465e-89e8-896571f16190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.698366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc72e9ea-2e57-465e-89e8-896571f16190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:04.699058 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72e9ea-2e57-465e-89e8-896571f16190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:04.701002 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc72e9ea-2e57-465e-89e8-896571f16190 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:04.729358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1439/2848] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:41:04 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:41:04.734319 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ecd77-c1a4-4ec3-b1fb-c31d54f9efc1 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:04.746017 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ecd77-c1a4-4ec3-b1fb-c31d54f9efc1 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:04.810647 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25823d8d-6b14-4512-8857-6ae4e915cab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:04.811588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25823d8d-6b14-4512-8857-6ae4e915cab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.812035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25823d8d-6b14-4512-8857-6ae4e915cab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.812318 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25823d8d-6b14-4512-8857-6ae4e915cab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:04.813102 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25823d8d-6b14-4512-8857-6ae4e915cab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:04.815048 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25823d8d-6b14-4512-8857-6ae4e915cab9 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:04.837329 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1410/2849] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:41:04 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:41:04.841597 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72e9ea-2e57-465e-89e8-896571f16190 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:04.852060 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc72e9ea-2e57-465e-89e8-896571f16190 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:04.856823 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe5bd5-e418-4ea8-86b8-01a25ad2fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:04.857515 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe5bd5-e418-4ea8-86b8-01a25ad2fa12 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.857800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe5bd5-e418-4ea8-86b8-01a25ad2fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.858071 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe5bd5-e418-4ea8-86b8-01a25ad2fa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:04.858794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe5bd5-e418-4ea8-86b8-01a25ad2fa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:04.860386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe5bd5-e418-4ea8-86b8-01a25ad2fa12 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:04.871878 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1440/2850] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:41:04.877678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25823d8d-6b14-4512-8857-6ae4e915cab9 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:04.894475 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25823d8d-6b14-4512-8857-6ae4e915cab9 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:04.901509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f190d3-8e47-4bba-bf12-6a8feca8913f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:04.902490 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f190d3-8e47-4bba-bf12-6a8feca8913f admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.902878 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f190d3-8e47-4bba-bf12-6a8feca8913f admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.903259 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f190d3-8e47-4bba-bf12-6a8feca8913f admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:04.904356 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f190d3-8e47-4bba-bf12-6a8feca8913f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:04.906556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f190d3-8e47-4bba-bf12-6a8feca8913f admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:04.917212 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1411/2851] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:41:04.923255 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe5bd5-e418-4ea8-86b8-01a25ad2fa12 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:04.938093 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe5bd5-e418-4ea8-86b8-01a25ad2fa12 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:04.942668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d4a3-eb82-4db7-8740-b15b150efc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:04.943551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d4a3-eb82-4db7-8740-b15b150efc75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.943831 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d4a3-eb82-4db7-8740-b15b150efc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.944107 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319d4a3-eb82-4db7-8740-b15b150efc75 admin admin] PATH_INFO: `/v3/projects/d6c3311c440347a3aaf3c8514a0bb4fe/users/991f2182a78e4014931a950abfe05b88/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:04.959198 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319d4a3-eb82-4db7-8740-b15b150efc75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c3311c440347a3aaf3c8514a0bb4fe, user_id=991f2182a78e4014931a950abfe05b88, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:04.961918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319d4a3-eb82-4db7-8740-b15b150efc75 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:04.964955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:04.980777 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1441/2852] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:41:04 2022] PUT /identity/v3/projects/d6c3311c440347a3aaf3c8514a0bb4fe/users/991f2182a78e4014931a950abfe05b88/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:41:04.986043 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e0a8-f693-4f84-ab0f-71e3b334dc82 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:04.986338 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e0a8-f693-4f84-ab0f-71e3b334dc82 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:04.986622 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22e0a8-f693-4f84-ab0f-71e3b334dc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:05.000323 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:05.006470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-9c22e0a8-f693-4f84-ab0f-71e3b334dc82 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:05.008641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-9c22e0a8-f693-4f84-ab0f-71e3b334dc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:05.070698 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1412/2853] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:05.082261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d4a3-eb82-4db7-8740-b15b150efc75 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:05.084319 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a319d4a3-eb82-4db7-8740-b15b150efc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:05.143516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319d4a3-eb82-4db7-8740-b15b150efc75 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:05.147315 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cb1dc-7685-46ad-aaad-0ca487dae533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:05.147956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb1dc-7685-46ad-aaad-0ca487dae533 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:05.148236 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb1dc-7685-46ad-aaad-0ca487dae533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:05.148504 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb1dc-7685-46ad-aaad-0ca487dae533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:05.157794 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cb1dc-7685-46ad-aaad-0ca487dae533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:05.159229 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1cb1dc-7685-46ad-aaad-0ca487dae533 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:05.168781 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1442/2854] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:05.801830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36a180-ec25-4e6a-8581-8cff4426ceb4 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:05.801830 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36a180-ec25-4e6a-8581-8cff4426ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:05.802125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36a180-ec25-4e6a-8581-8cff4426ceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:05.830598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-7c36a180-ec25-4e6a-8581-8cff4426ceb4 None None] MFA Rules not processed for user `991f2182a78e4014931a950abfe05b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:05.831828 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-7c36a180-ec25-4e6a-8581-8cff4426ceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:05.900945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1413/2855] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:05.911938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cb1dc-7685-46ad-aaad-0ca487dae533 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:05.913516 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-5d1cb1dc-7685-46ad-aaad-0ca487dae533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:05.972930 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1cb1dc-7685-46ad-aaad-0ca487dae533 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:05.976688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2987d0f-4627-4f94-aab5-9c53b2c0cf66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4980d7e51e84655add2a53808818598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:05.977386 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987d0f-4627-4f94-aab5-9c53b2c0cf66 service cinder] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:05.977668 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987d0f-4627-4f94-aab5-9c53b2c0cf66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:05.977963 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987d0f-4627-4f94-aab5-9c53b2c0cf66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:05.987023 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2987d0f-4627-4f94-aab5-9c53b2c0cf66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:05.988492 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2987d0f-4627-4f94-aab5-9c53b2c0cf66 service cinder] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:05.997858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1443/2856] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:07.391236 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9ca68-a6fc-447d-a766-ff33bc8d1742 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:07.391802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9ca68-a6fc-447d-a766-ff33bc8d1742 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:07.391802 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9ca68-a6fc-447d-a766-ff33bc8d1742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:07.411539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-48e9ca68-a6fc-447d-a766-ff33bc8d1742 None None] MFA Rules not processed for user `991f2182a78e4014931a950abfe05b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:07.412775 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-48e9ca68-a6fc-447d-a766-ff33bc8d1742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:07.421016 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1414/2857] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:10.646050 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2987d0f-4627-4f94-aab5-9c53b2c0cf66 service cinder] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:10.647758 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a2987d0f-4627-4f94-aab5-9c53b2c0cf66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:10.661117 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2987d0f-4627-4f94-aab5-9c53b2c0cf66 service cinder] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:10.665696 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:10.666347 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:10.666633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:10.666908 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:10.669047 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:10.679141 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:10.680582 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:10.688882 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1444/2858] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:17.405311 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=59 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:20.685114 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=60 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:33.786400 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d845f0-2861-492b-8828-06280f3bbe7c None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:33.786902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d845f0-2861-492b-8828-06280f3bbe7c None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:33.786902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d845f0-2861-492b-8828-06280f3bbe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:33.806910 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-14d845f0-2861-492b-8828-06280f3bbe7c None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:33.808139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-14d845f0-2861-492b-8828-06280f3bbe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:33.818173 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1415/2859] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:33.844136 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:33.845871 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:33.928092 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99837f-0fc4-430c-b137-f3ee610a9754 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:33.934732 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd24a22-061e-42dc-8555-9a74579a4893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:33.935372 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd24a22-061e-42dc-8555-9a74579a4893 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:33.935651 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd24a22-061e-42dc-8555-9a74579a4893 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:33.935923 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd24a22-061e-42dc-8555-9a74579a4893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:33.945053 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd24a22-061e-42dc-8555-9a74579a4893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:33.946642 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd24a22-061e-42dc-8555-9a74579a4893 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:33.956626 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1445/2860] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:36.868501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07082f-9f50-4ced-af8f-03fb237d7be8 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:36.869084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07082f-9f50-4ced-af8f-03fb237d7be8 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:36.869084 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07082f-9f50-4ced-af8f-03fb237d7be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:36.887803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2b07082f-9f50-4ced-af8f-03fb237d7be8 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:36.889165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2b07082f-9f50-4ced-af8f-03fb237d7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:36.897409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1416/2861] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:36.917104 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd24a22-061e-42dc-8555-9a74579a4893 service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:36.918945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-8fd24a22-061e-42dc-8555-9a74579a4893 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:36.934686 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd24a22-061e-42dc-8555-9a74579a4893 service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:36.940967 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3de616-c630-4964-b3e8-513355a0c99e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:36.941607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3de616-c630-4964-b3e8-513355a0c99e service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:36.941885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3de616-c630-4964-b3e8-513355a0c99e service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:36.942167 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3de616-c630-4964-b3e8-513355a0c99e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:36.950688 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3de616-c630-4964-b3e8-513355a0c99e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:36.952384 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3de616-c630-4964-b3e8-513355a0c99e service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:36.962344 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1446/2862] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:40.143919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d72631-e2e3-4a28-ab97-f8dc8948c679 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:40.144565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d72631-e2e3-4a28-ab97-f8dc8948c679 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:40.144565 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d72631-e2e3-4a28-ab97-f8dc8948c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:40.163953 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-24d72631-e2e3-4a28-ab97-f8dc8948c679 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:40.165202 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-24d72631-e2e3-4a28-ab97-f8dc8948c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:40.174853 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1417/2863] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:40.197421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3de616-c630-4964-b3e8-513355a0c99e service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:40.209778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3de616-c630-4964-b3e8-513355a0c99e service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:40.216828 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751803b8-634a-4434-83cb-1ada1588ed0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:40.217538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751803b8-634a-4434-83cb-1ada1588ed0d service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:40.217820 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751803b8-634a-4434-83cb-1ada1588ed0d service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:40.218098 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751803b8-634a-4434-83cb-1ada1588ed0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:40.226846 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751803b8-634a-4434-83cb-1ada1588ed0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:40.228461 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751803b8-634a-4434-83cb-1ada1588ed0d service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:40.238462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1447/2864] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:43.263709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342c851-68fc-4719-a91a-8262d1d8faa3 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:43.264183 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342c851-68fc-4719-a91a-8262d1d8faa3 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:43.264290 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342c851-68fc-4719-a91a-8262d1d8faa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:43.284053 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-b342c851-68fc-4719-a91a-8262d1d8faa3 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:43.285355 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-b342c851-68fc-4719-a91a-8262d1d8faa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:43.294480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1418/2865] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 01 16:41:43.317948 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751803b8-634a-4434-83cb-1ada1588ed0d service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:43.330272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751803b8-634a-4434-83cb-1ada1588ed0d service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:43.337864 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dbf01-67f7-467d-bc55-b64b65e475db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:43.338866 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dbf01-67f7-467d-bc55-b64b65e475db service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:43.339158 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dbf01-67f7-467d-bc55-b64b65e475db service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:43.339431 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884dbf01-67f7-467d-bc55-b64b65e475db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:43.349521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884dbf01-67f7-467d-bc55-b64b65e475db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:43.351046 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884dbf01-67f7-467d-bc55-b64b65e475db service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:43.362186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1448/2866] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:46.445976 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ca71-7843-4855-857c-b201067ab992 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:46.446510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ca71-7843-4855-857c-b201067ab992 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:46.446510 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291ca71-7843-4855-857c-b201067ab992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:46.466456 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-2291ca71-7843-4855-857c-b201067ab992 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:46.467662 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-2291ca71-7843-4855-857c-b201067ab992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:46.476945 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1419/2867] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:46.500108 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dbf01-67f7-467d-bc55-b64b65e475db service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:46.512283 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884dbf01-67f7-467d-bc55-b64b65e475db service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:46.518893 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4084-b807-4364-8552-0ba9d62081e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:46.519784 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4084-b807-4364-8552-0ba9d62081e3 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:46.520029 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4084-b807-4364-8552-0ba9d62081e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:46.520297 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f4084-b807-4364-8552-0ba9d62081e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:46.533976 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f4084-b807-4364-8552-0ba9d62081e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:46.536366 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f4084-b807-4364-8552-0ba9d62081e3 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:46.551176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1449/2868] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:49.639904 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d04515-0faf-42a7-bfb8-1006e3f05909 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:49.640470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d04515-0faf-42a7-bfb8-1006e3f05909 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:49.640470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d04515-0faf-42a7-bfb8-1006e3f05909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:49.660314 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-89d04515-0faf-42a7-bfb8-1006e3f05909 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:41:49.661566 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-89d04515-0faf-42a7-bfb8-1006e3f05909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:49.671704 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1420/2869] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:41:49.695041 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4084-b807-4364-8552-0ba9d62081e3 service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:49.707129 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f4084-b807-4364-8552-0ba9d62081e3 service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:49.713599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc49884-0af2-4fa2-a410-7133eff3e2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:49.714241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc49884-0af2-4fa2-a410-7133eff3e2dd service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:49.714526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc49884-0af2-4fa2-a410-7133eff3e2dd service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:49.714801 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc49884-0af2-4fa2-a410-7133eff3e2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:49.723287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc49884-0af2-4fa2-a410-7133eff3e2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:49.724969 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc49884-0af2-4fa2-a410-7133eff3e2dd service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:49.735190 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1450/2870] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:59.506889 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d04515-0faf-42a7-bfb8-1006e3f05909 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:41:59.514105 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=19 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:41:59.521858 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d04515-0faf-42a7-bfb8-1006e3f05909 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:41:59.527428 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5edd2-1f58-4dd0-ad78-b87b8dcebb52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:41:59.528090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5edd2-1f58-4dd0-ad78-b87b8dcebb52 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:41:59.528373 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5edd2-1f58-4dd0-ad78-b87b8dcebb52 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:41:59.528666 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5edd2-1f58-4dd0-ad78-b87b8dcebb52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:41:59.530649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-3da5edd2-1f58-4dd0-ad78-b87b8dcebb52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:41:59.544160 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5edd2-1f58-4dd0-ad78-b87b8dcebb52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:41:59.545821 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5edd2-1f58-4dd0-ad78-b87b8dcebb52 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:41:59.557252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1421/2871] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:41:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:41:59.730557 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=64 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:04.016349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a303-e6bd-4284-bb97-83da3c6b348e None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:04.016960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a303-e6bd-4284-bb97-83da3c6b348e None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:04.016960 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06a303-e6bd-4284-bb97-83da3c6b348e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:04.036216 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-3a06a303-e6bd-4284-bb97-83da3c6b348e None None] MFA Rules not processed for user `991f2182a78e4014931a950abfe05b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:42:04.037473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3a06a303-e6bd-4284-bb97-83da3c6b348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:04.045826 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1451/2872] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:42:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:42:04.282028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5edd2-1f58-4dd0-ad78-b87b8dcebb52 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:42:04.292135 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5edd2-1f58-4dd0-ad78-b87b8dcebb52 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:42:04.296455 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309a83d-7130-4f63-b8c1-c2fe6a4b4db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:42:04.297144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a83d-7130-4f63-b8c1-c2fe6a4b4db1 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:04.297424 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a83d-7130-4f63-b8c1-c2fe6a4b4db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:04.297695 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309a83d-7130-4f63-b8c1-c2fe6a4b4db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:04.299556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f309a83d-7130-4f63-b8c1-c2fe6a4b4db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:04.309583 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309a83d-7130-4f63-b8c1-c2fe6a4b4db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:42:04.311033 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309a83d-7130-4f63-b8c1-c2fe6a4b4db1 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:42:04.320115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1422/2873] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:42:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:42:04.651588 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06a303-e6bd-4284-bb97-83da3c6b348e None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:42:04.653176 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-3a06a303-e6bd-4284-bb97-83da3c6b348e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:04.748786 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06a303-e6bd-4284-bb97-83da3c6b348e None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:42:04.755257 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20460ac7-2e48-4706-a7a5-8612524a8200 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:42:04.755921 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20460ac7-2e48-4706-a7a5-8612524a8200 service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:04.756205 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20460ac7-2e48-4706-a7a5-8612524a8200 service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:04.756483 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20460ac7-2e48-4706-a7a5-8612524a8200 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:04.758542 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-20460ac7-2e48-4706-a7a5-8612524a8200 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:04.770637 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20460ac7-2e48-4706-a7a5-8612524a8200 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:42:04.772172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20460ac7-2e48-4706-a7a5-8612524a8200 service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:42:04.782241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1452/2874] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:42:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:42:11.876738 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309a83d-7130-4f63-b8c1-c2fe6a4b4db1 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:42:11.891752 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309a83d-7130-4f63-b8c1-c2fe6a4b4db1 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:42:11.897599 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f9135-3224-46da-9abd-6416df59bc2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:42:11.898252 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f9135-3224-46da-9abd-6416df59bc2d service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:11.898533 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f9135-3224-46da-9abd-6416df59bc2d service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:11.898806 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f9135-3224-46da-9abd-6416df59bc2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:11.900608 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-609f9135-3224-46da-9abd-6416df59bc2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:11.914041 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f9135-3224-46da-9abd-6416df59bc2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:42:11.915649 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f9135-3224-46da-9abd-6416df59bc2d service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:42:11.927116 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1423/2875] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:42:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:42:14.778036 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=35 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:16.871278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766ecf-e8db-49db-9cd6-6f85ceea0e30 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:16.871997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766ecf-e8db-49db-9cd6-6f85ceea0e30 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:16.871997 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00766ecf-e8db-49db-9cd6-6f85ceea0e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:16.897353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-00766ecf-e8db-49db-9cd6-6f85ceea0e30 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:42:16.898569 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-00766ecf-e8db-49db-9cd6-6f85ceea0e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:16.910485 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1453/2876] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:42:16.932213 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f9135-3224-46da-9abd-6416df59bc2d service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:42:16.944023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f9135-3224-46da-9abd-6416df59bc2d service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:42:16.950585 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ae92-80eb-4661-b8c1-ac1e8ad3326b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:42:16.951242 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ae92-80eb-4661-b8c1-ac1e8ad3326b service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:16.951501 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ae92-80eb-4661-b8c1-ac1e8ad3326b service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:16.951783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426ae92-80eb-4661-b8c1-ac1e8ad3326b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:16.960653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ae92-80eb-4661-b8c1-ac1e8ad3326b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:42:16.962286 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426ae92-80eb-4661-b8c1-ac1e8ad3326b service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:42:16.971778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1424/2877] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:42:20.157551 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829412d-c8c4-4e59-9f0d-5bd8e1f07a18 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:20.158148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829412d-c8c4-4e59-9f0d-5bd8e1f07a18 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:20.158148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829412d-c8c4-4e59-9f0d-5bd8e1f07a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:20.178559 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-2829412d-c8c4-4e59-9f0d-5bd8e1f07a18 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:42:20.179945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2829412d-c8c4-4e59-9f0d-5bd8e1f07a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:20.189762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1454/2878] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:42:20.212577 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ae92-80eb-4661-b8c1-ac1e8ad3326b service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:42:20.224426 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426ae92-80eb-4661-b8c1-ac1e8ad3326b service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:42:20.231449 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcacb9-0394-43dc-a5c4-ea202f22eb15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:42:20.232090 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcacb9-0394-43dc-a5c4-ea202f22eb15 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:20.232371 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcacb9-0394-43dc-a5c4-ea202f22eb15 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:20.232641 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcacb9-0394-43dc-a5c4-ea202f22eb15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:20.241645 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcacb9-0394-43dc-a5c4-ea202f22eb15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:42:20.243261 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcacb9-0394-43dc-a5c4-ea202f22eb15 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:42:20.252899 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1425/2879] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:42:23.262555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc7ac5-db12-4e75-a087-c5e3a3158ab7 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:23.263122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc7ac5-db12-4e75-a087-c5e3a3158ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:23.263122 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc7ac5-db12-4e75-a087-c5e3a3158ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:23.287692 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bbdc7ac5-db12-4e75-a087-c5e3a3158ab7 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:42:23.289132 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bbdc7ac5-db12-4e75-a087-c5e3a3158ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:23.298722 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1455/2880] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:42:23.319702 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcacb9-0394-43dc-a5c4-ea202f22eb15 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:42:23.331888 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcacb9-0394-43dc-a5c4-ea202f22eb15 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:42:23.339074 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937180-f5a7-43bd-9402-5ac5e0e48f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:42:23.339717 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937180-f5a7-43bd-9402-5ac5e0e48f26 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:23.340012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937180-f5a7-43bd-9402-5ac5e0e48f26 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:23.340270 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b937180-f5a7-43bd-9402-5ac5e0e48f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:23.349293 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b937180-f5a7-43bd-9402-5ac5e0e48f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:42:23.350846 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b937180-f5a7-43bd-9402-5ac5e0e48f26 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:42:23.360498 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1426/2881] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:42:26.435324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a1c5b-284d-4740-9a98-732366fb0040 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:26.436224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a1c5b-284d-4740-9a98-732366fb0040 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:26.436224 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a1c5b-284d-4740-9a98-732366fb0040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:26.464952 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-bf9a1c5b-284d-4740-9a98-732366fb0040 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:42:26.466158 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-bf9a1c5b-284d-4740-9a98-732366fb0040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:26.475663 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1456/2882] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:42:26.504701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937180-f5a7-43bd-9402-5ac5e0e48f26 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:42:26.516472 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b937180-f5a7-43bd-9402-5ac5e0e48f26 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:42:26.523790 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fea823-681a-4e89-a5fd-cb6ebc914272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:42:26.524446 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fea823-681a-4e89-a5fd-cb6ebc914272 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:26.524721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fea823-681a-4e89-a5fd-cb6ebc914272 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:26.525035 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fea823-681a-4e89-a5fd-cb6ebc914272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:26.534221 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fea823-681a-4e89-a5fd-cb6ebc914272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:42:26.535857 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fea823-681a-4e89-a5fd-cb6ebc914272 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:42:26.545789 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1427/2883] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:42:31.690971 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8a0a2-b4ca-47cc-a7e0-579ca41ffe4d None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:31.691497 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8a0a2-b4ca-47cc-a7e0-579ca41ffe4d None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:31.691619 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8a0a2-b4ca-47cc-a7e0-579ca41ffe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:31.711286 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-30b8a0a2-b4ca-47cc-a7e0-579ca41ffe4d None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:42:31.712506 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-30b8a0a2-b4ca-47cc-a7e0-579ca41ffe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:42:31.722355 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1457/2884] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 1 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:42:31.747992 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fea823-681a-4e89-a5fd-cb6ebc914272 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:42:31.753713 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=42 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:31.761229 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fea823-681a-4e89-a5fd-cb6ebc914272 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:42:31.767892 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975422-69ac-4d39-aec6-7c30400ad4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:42:31.768544 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975422-69ac-4d39-aec6-7c30400ad4b6 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:31.768825 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975422-69ac-4d39-aec6-7c30400ad4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:31.769115 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1975422-69ac-4d39-aec6-7c30400ad4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:31.778506 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1975422-69ac-4d39-aec6-7c30400ad4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:42:31.780165 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1975422-69ac-4d39-aec6-7c30400ad4b6 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:42:31.790088 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1428/2885] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:42:41.705816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=15 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:41.785746 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=5 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:42:59.894247 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8a0a2-b4ca-47cc-a7e0-579ca41ffe4d None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:42:59.960816 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8a0a2-b4ca-47cc-a7e0-579ca41ffe4d None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:42:59.966446 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:42:59.967367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:42:59.967673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:42:59.967919 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] PATH_INFO: `/v3/users/991f2182a78e4014931a950abfe05b88` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:42:59.969297 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] RBAC: Authorizing `identity:delete_user(user_id=991f2182a78e4014931a950abfe05b88)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:42:59.971307 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:00.024558 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991f2182a78e4014931a950abfe05b88'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.025246 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991f2182a78e4014931a950abfe05b88'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.034560 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991f2182a78e4014931a950abfe05b88'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.041850 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991f2182a78e4014931a950abfe05b88'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.042473 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-52f5bf39-5d38-42ed-9222-49024d61887f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991f2182a78e4014931a950abfe05b88'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.059601 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1458/2886] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:42:59 2022] DELETE /identity/v3/users/991f2182a78e4014931a950abfe05b88 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:43:00.243803 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975422-69ac-4d39-aec6-7c30400ad4b6 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:00.294895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1975422-69ac-4d39-aec6-7c30400ad4b6 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:00.356872 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:00.357801 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.358055 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.358342 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] PATH_INFO: `/v3/projects/d6c3311c440347a3aaf3c8514a0bb4fe` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.359558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c3311c440347a3aaf3c8514a0bb4fe)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:00.361539 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:00.412895 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c3311c440347a3aaf3c8514a0bb4fe', 'request_id': 'req-2046deb9-324e-4b43-aba4-f57f5f0d463a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.418708 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c3311c440347a3aaf3c8514a0bb4fe', 'request_id': 'req-2046deb9-324e-4b43-aba4-f57f5f0d463a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.430321 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c3311c440347a3aaf3c8514a0bb4fe', 'request_id': 'req-2046deb9-324e-4b43-aba4-f57f5f0d463a'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.454028 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] The token cache is being invalidate because project d6c3311c440347a3aaf3c8514a0bb4fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:43:00.454302 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.455386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-2046deb9-324e-4b43-aba4-f57f5f0d463a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:43:00.457109 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1429/2887] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:43:00 2022] DELETE /identity/v3/projects/d6c3311c440347a3aaf3c8514a0bb4fe => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:43:00.463874 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775211a-04ab-495e-bdf9-49a605b1c0e2 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.464193 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775211a-04ab-495e-bdf9-49a605b1c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.464477 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775211a-04ab-495e-bdf9-49a605b1c0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.508353 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-1775211a-04ab-495e-bdf9-49a605b1c0e2 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:43:00.509632 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-1775211a-04ab-495e-bdf9-49a605b1c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:00.570027 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1459/2888] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:43:00.578556 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d6197-d505-4e38-8198-30d8a3127b58 None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.578841 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d6197-d505-4e38-8198-30d8a3127b58 None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.579114 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d6197-d505-4e38-8198-30d8a3127b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.604859 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-0c8d6197-d505-4e38-8198-30d8a3127b58 None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:43:00.606163 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-0c8d6197-d505-4e38-8198-30d8a3127b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:00.614720 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1430/2889] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:43:00.619155 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775211a-04ab-495e-bdf9-49a605b1c0e2 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:00.629728 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775211a-04ab-495e-bdf9-49a605b1c0e2 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:00.635629 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79f384-e3ab-4b20-9128-504f09af3e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:00.636282 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f384-e3ab-4b20-9128-504f09af3e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.636693 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f384-e3ab-4b20-9128-504f09af3e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.637017 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79f384-e3ab-4b20-9128-504f09af3e9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.637749 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f384-e3ab-4b20-9128-504f09af3e9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80130) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 01 16:43:00.638059 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f384-e3ab-4b20-9128-504f09af3e9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:00.639661 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79f384-e3ab-4b20-9128-504f09af3e9c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:00.651622 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1460/2890] 10.222.0.59 () {58 vars in 1152 bytes} [Fri Jul 1 16:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 01 16:43:00.655956 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d6197-d505-4e38-8198-30d8a3127b58 None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:00.665358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d6197-d505-4e38-8198-30d8a3127b58 None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:00.670409 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d46a-3046-4dbc-a279-b26fc59d5754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:00.671122 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d46a-3046-4dbc-a279-b26fc59d5754 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.671352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d46a-3046-4dbc-a279-b26fc59d5754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.671653 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0d46a-3046-4dbc-a279-b26fc59d5754 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.672382 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d46a-3046-4dbc-a279-b26fc59d5754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:00.674419 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0d46a-3046-4dbc-a279-b26fc59d5754 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:00.703990 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1431/2891] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:43:00 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:43:00.708451 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79f384-e3ab-4b20-9128-504f09af3e9c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:00.715111 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:00.718914 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79f384-e3ab-4b20-9128-504f09af3e9c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:00.777472 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e25b0b-2d6a-410c-b426-ce97658de3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:00.778149 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e25b0b-2d6a-410c-b426-ce97658de3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.778429 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e25b0b-2d6a-410c-b426-ce97658de3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.778703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e25b0b-2d6a-410c-b426-ce97658de3aa admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.779398 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e25b0b-2d6a-410c-b426-ce97658de3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:00.781363 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e25b0b-2d6a-410c-b426-ce97658de3aa admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:00.804057 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1461/2892] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:43:00 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 01 16:43:00.808509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d46a-3046-4dbc-a279-b26fc59d5754 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:00.819012 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0d46a-3046-4dbc-a279-b26fc59d5754 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:00.824678 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3319f8c-2fd5-487c-ada4-53bf8e6d8c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:00.825315 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3319f8c-2fd5-487c-ada4-53bf8e6d8c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.825598 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3319f8c-2fd5-487c-ada4-53bf8e6d8c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.825874 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3319f8c-2fd5-487c-ada4-53bf8e6d8c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.826607 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3319f8c-2fd5-487c-ada4-53bf8e6d8c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:00.828207 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3319f8c-2fd5-487c-ada4-53bf8e6d8c39 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:00.838588 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1432/2893] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:43:00.842481 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e25b0b-2d6a-410c-b426-ce97658de3aa admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:00.852607 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e25b0b-2d6a-410c-b426-ce97658de3aa admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:00.857837 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873c21a-1a94-4536-91ca-b4a0cf2b21e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:00.858488 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873c21a-1a94-4536-91ca-b4a0cf2b21e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.858989 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873c21a-1a94-4536-91ca-b4a0cf2b21e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.859292 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873c21a-1a94-4536-91ca-b4a0cf2b21e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.860020 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873c21a-1a94-4536-91ca-b4a0cf2b21e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:00.861662 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873c21a-1a94-4536-91ca-b4a0cf2b21e2 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:00.871830 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1462/2894] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:43:00.876509 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3319f8c-2fd5-487c-ada4-53bf8e6d8c39 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:00.892340 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3319f8c-2fd5-487c-ada4-53bf8e6d8c39 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:00.901524 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80127f30-52ff-48a6-b834-4c397b9ebc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:00.902778 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80127f30-52ff-48a6-b834-4c397b9ebc6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.903096 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80127f30-52ff-48a6-b834-4c397b9ebc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.903364 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80127f30-52ff-48a6-b834-4c397b9ebc6b admin admin] PATH_INFO: `/v3/projects/80030dae585441f483c86fcd0193335d/users/a79d91a8c6d3455ba44eeccd2ba9d979/roles/bd597f50c9ba47888ac496a996ba3b71` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.906251 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:00.924091 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80127f30-52ff-48a6-b834-4c397b9ebc6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=80030dae585441f483c86fcd0193335d, user_id=a79d91a8c6d3455ba44eeccd2ba9d979, role_id=bd597f50c9ba47888ac496a996ba3b71)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:00.926820 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80127f30-52ff-48a6-b834-4c397b9ebc6b admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:00.942569 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1433/2895] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:43:00 2022] PUT /identity/v3/projects/80030dae585441f483c86fcd0193335d/users/a79d91a8c6d3455ba44eeccd2ba9d979/roles/bd597f50c9ba47888ac496a996ba3b71 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 01 16:43:00.947945 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f65e61-56df-4fc4-b4fb-d49282d1682b None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:00.948445 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f65e61-56df-4fc4-b4fb-d49282d1682b None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:00.948581 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f65e61-56df-4fc4-b4fb-d49282d1682b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:00.967490 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-61f65e61-56df-4fc4-b4fb-d49282d1682b None None] MFA Rules not processed for user `355fb13b7be647a8a84fa02e8179fe7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:43:00.968713 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-61f65e61-56df-4fc4-b4fb-d49282d1682b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:01.037049 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1463/2896] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:43:01.046922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80127f30-52ff-48a6-b834-4c397b9ebc6b admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:01.048757 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-80127f30-52ff-48a6-b834-4c397b9ebc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:01.143787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80127f30-52ff-48a6-b834-4c397b9ebc6b admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:01.149515 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620d83f-e25e-488a-ad7c-a42cbbbcfbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:01.150433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620d83f-e25e-488a-ad7c-a42cbbbcfbdf service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:01.150811 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620d83f-e25e-488a-ad7c-a42cbbbcfbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:01.151176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620d83f-e25e-488a-ad7c-a42cbbbcfbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:01.162062 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620d83f-e25e-488a-ad7c-a42cbbbcfbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:01.163530 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620d83f-e25e-488a-ad7c-a42cbbbcfbdf service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:01.173335 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1434/2897] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:43:05.145579 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126d95-3418-4f01-93a5-077321eb7f38 None None] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:05.146103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126d95-3418-4f01-93a5-077321eb7f38 None None] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:05.146103 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73126d95-3418-4f01-93a5-077321eb7f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:05.177624 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.auth.core [None req-73126d95-3418-4f01-93a5-077321eb7f38 None None] MFA Rules not processed for user `a79d91a8c6d3455ba44eeccd2ba9d979`. Rule list: `[]` (Enabled: `True`). {{(pid=80130) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:43:05.179121 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-73126d95-3418-4f01-93a5-077321eb7f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:05.254196 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1464/2898] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:43:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:43:05.258797 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620d83f-e25e-488a-ad7c-a42cbbbcfbdf service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:05.269245 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620d83f-e25e-488a-ad7c-a42cbbbcfbdf service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:05.274075 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6b190-4e19-4439-b6e7-f756f4034ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:05.274742 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b190-4e19-4439-b6e7-f756f4034ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:05.275019 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b190-4e19-4439-b6e7-f756f4034ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:05.275288 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6b190-4e19-4439-b6e7-f756f4034ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:05.275975 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6b190-4e19-4439-b6e7-f756f4034ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:05.277964 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6b190-4e19-4439-b6e7-f756f4034ae8 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:05.311054 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1435/2899] 10.222.0.59 () {60 vars in 1152 bytes} [Fri Jul 1 16:43:05 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:43:05.314373 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126d95-3418-4f01-93a5-077321eb7f38 None None] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:05.325555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73126d95-3418-4f01-93a5-077321eb7f38 None None] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:05.336003 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:05.398633 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87db7b7-6322-483d-be47-8feef01d87e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:05.399334 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87db7b7-6322-483d-be47-8feef01d87e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:05.399615 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87db7b7-6322-483d-be47-8feef01d87e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:05.399888 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87db7b7-6322-483d-be47-8feef01d87e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:05.400583 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87db7b7-6322-483d-be47-8feef01d87e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:05.402655 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87db7b7-6322-483d-be47-8feef01d87e7 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:05.426935 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1465/2900] 10.222.0.59 () {60 vars in 1143 bytes} [Fri Jul 1 16:43:05 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 01 16:43:05.431511 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6b190-4e19-4439-b6e7-f756f4034ae8 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:05.444468 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6b190-4e19-4439-b6e7-f756f4034ae8 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:05.455481 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16241e-57df-4f74-a773-b954a3065752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:05.456186 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16241e-57df-4f74-a773-b954a3065752 admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:05.456469 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16241e-57df-4f74-a773-b954a3065752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:05.456744 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16241e-57df-4f74-a773-b954a3065752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:05.457527 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16241e-57df-4f74-a773-b954a3065752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:05.459178 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16241e-57df-4f74-a773-b954a3065752 admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:05.470310 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1436/2901] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 01 16:43:05.474657 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87db7b7-6322-483d-be47-8feef01d87e7 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:05.485305 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87db7b7-6322-483d-be47-8feef01d87e7 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:05.490325 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392caf09-0ce8-4c2c-a721-ddc72224c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:05.491235 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392caf09-0ce8-4c2c-a721-ddc72224c6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:05.491521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392caf09-0ce8-4c2c-a721-ddc72224c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:05.491797 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392caf09-0ce8-4c2c-a721-ddc72224c6e3 admin admin] PATH_INFO: `/v3/projects/099b860154aa4958912e87b78e21d234/users/fdd199a7827d4e49b9d79ddbd89caeeb/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:05.510596 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392caf09-0ce8-4c2c-a721-ddc72224c6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099b860154aa4958912e87b78e21d234, user_id=fdd199a7827d4e49b9d79ddbd89caeeb, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:05.513462 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392caf09-0ce8-4c2c-a721-ddc72224c6e3 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:05.532885 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1466/2902] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:43:05 2022] PUT /identity/v3/projects/099b860154aa4958912e87b78e21d234/users/fdd199a7827d4e49b9d79ddbd89caeeb/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:43:05.536057 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16241e-57df-4f74-a773-b954a3065752 admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:05.548190 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16241e-57df-4f74-a773-b954a3065752 admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:05.607405 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b84454-098a-4108-96ab-70fb770b970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:05.608094 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b84454-098a-4108-96ab-70fb770b970d admin admin] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:05.608380 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b84454-098a-4108-96ab-70fb770b970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:05.608656 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b84454-098a-4108-96ab-70fb770b970d admin admin] PATH_INFO: `/v3/roles` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:05.609491 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b84454-098a-4108-96ab-70fb770b970d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:05.611126 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b84454-098a-4108-96ab-70fb770b970d admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:05.621324 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1437/2903] 10.222.0.59 () {58 vars in 1121 bytes} [Fri Jul 1 16:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 01 16:43:05.625956 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392caf09-0ce8-4c2c-a721-ddc72224c6e3 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:05.636416 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392caf09-0ce8-4c2c-a721-ddc72224c6e3 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:05.641120 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4fa1f-16c7-4131-bb58-8afe61e90175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:05.642012 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4fa1f-16c7-4131-bb58-8afe61e90175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:05.642287 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4fa1f-16c7-4131-bb58-8afe61e90175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:05.642555 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4fa1f-16c7-4131-bb58-8afe61e90175 admin admin] PATH_INFO: `/v3/projects/099b860154aa4958912e87b78e21d234/users/fdd199a7827d4e49b9d79ddbd89caeeb/roles/842af9e8967047df873d061df391e820` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:05.644489 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4fa1f-16c7-4131-bb58-8afe61e90175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=099b860154aa4958912e87b78e21d234, user_id=fdd199a7827d4e49b9d79ddbd89caeeb, role_id=842af9e8967047df873d061df391e820)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:05.647723 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4fa1f-16c7-4131-bb58-8afe61e90175 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:05.658925 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1467/2904] 10.222.0.59 () {60 vars in 1482 bytes} [Fri Jul 1 16:43:05 2022] PUT /identity/v3/projects/099b860154aa4958912e87b78e21d234/users/fdd199a7827d4e49b9d79ddbd89caeeb/roles/842af9e8967047df873d061df391e820 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:43:10.130763 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eea92-2904-4c16-9601-424b3d55230d None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:10.131352 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eea92-2904-4c16-9601-424b3d55230d None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:10.131779 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eea92-2904-4c16-9601-424b3d55230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:10.161341 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:10.170244 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-aa5eea92-2904-4c16-9601-424b3d55230d None None] MFA Rules not processed for user `fdd199a7827d4e49b9d79ddbd89caeeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:43:10.171523 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-aa5eea92-2904-4c16-9601-424b3d55230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:10.265176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1438/2905] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:43:10.285152 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4fa1f-16c7-4131-bb58-8afe61e90175 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:10.287146 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e9b4fa1f-16c7-4131-bb58-8afe61e90175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:10.369762 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4fa1f-16c7-4131-bb58-8afe61e90175 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:10.375272 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a46538-2498-4465-95c6-237b75e14479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:10.376178 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a46538-2498-4465-95c6-237b75e14479 service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:10.376617 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a46538-2498-4465-95c6-237b75e14479 service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:10.377684 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a46538-2498-4465-95c6-237b75e14479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:10.436350 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a46538-2498-4465-95c6-237b75e14479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:10.438044 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a46538-2498-4465-95c6-237b75e14479 service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:10.447670 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1468/2906] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:43:11.481140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51339c-b8ec-4146-a1df-0c0c82c0ebdb None None] REQUEST_METHOD: `POST` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:11.481654 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51339c-b8ec-4146-a1df-0c0c82c0ebdb None None] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:11.481773 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51339c-b8ec-4146-a1df-0c0c82c0ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:11.501250 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.auth.core [None req-6c51339c-b8ec-4146-a1df-0c0c82c0ebdb None None] MFA Rules not processed for user `a79d91a8c6d3455ba44eeccd2ba9d979`. Rule list: `[]` (Enabled: `True`). {{(pid=80131) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 01 16:43:11.502756 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6c51339c-b8ec-4146-a1df-0c0c82c0ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:11.510181 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1439/2907] 10.222.0.59 () {58 vars in 957 bytes} [Fri Jul 1 16:43:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 01 16:43:20.443352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:21.495531 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=31 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:35.220708 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a46538-2498-4465-95c6-237b75e14479 service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:35.286303 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a46538-2498-4465-95c6-237b75e14479 service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:35.290731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174bbb0-c776-41b8-812f-c2cc3890461d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:35.291394 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174bbb0-c776-41b8-812f-c2cc3890461d service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:35.291666 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174bbb0-c776-41b8-812f-c2cc3890461d service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:35.292182 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174bbb0-c776-41b8-812f-c2cc3890461d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:35.302526 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174bbb0-c776-41b8-812f-c2cc3890461d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:35.303990 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174bbb0-c776-41b8-812f-c2cc3890461d service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:35.314442 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1469/2908] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:43:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:43:37.141013 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51339c-b8ec-4146-a1df-0c0c82c0ebdb None None] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:43:37.142650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6c51339c-b8ec-4146-a1df-0c0c82c0ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:37.167513 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c51339c-b8ec-4146-a1df-0c0c82c0ebdb None None] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:43:37.173628 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:43:37.174320 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:43:37.174600 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:43:37.174879 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:43:37.176740 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:43:37.189196 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:43:37.190787 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:43:37.203914 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1440/2909] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:43:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:43:45.309778 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=26 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:43:47.197111 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=9 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:44:44.348484 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174bbb0-c776-41b8-812f-c2cc3890461d service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:44:44.350665 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-a174bbb0-c776-41b8-812f-c2cc3890461d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:44:44.471899 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174bbb0-c776-41b8-812f-c2cc3890461d service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:44:44.477818 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0b84-06fb-4ae9-afa1-39c044649549 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:44:44.478572 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0b84-06fb-4ae9-afa1-39c044649549 service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:44:44.478926 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0b84-06fb-4ae9-afa1-39c044649549 service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:44:44.479213 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0b84-06fb-4ae9-afa1-39c044649549 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:44:44.481430 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-e7db0b84-06fb-4ae9-afa1-39c044649549 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:44:44.493991 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0b84-06fb-4ae9-afa1-39c044649549 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:44:44.495646 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0b84-06fb-4ae9-afa1-39c044649549 service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:44:44.506175 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1470/2910] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:44:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:44:54.501858 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=41 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:32.774271 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:45:32.775807 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:45:32.790141 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e7178-6d11-439e-b799-152656d47be6 service nova] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:45:32.796087 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11744d8-f79b-49e2-b06c-1ceb707dfef5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:45:32.797014 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11744d8-f79b-49e2-b06c-1ceb707dfef5 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:45:32.797289 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11744d8-f79b-49e2-b06c-1ceb707dfef5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:45:32.797571 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11744d8-f79b-49e2-b06c-1ceb707dfef5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:45:32.799961 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c11744d8-f79b-49e2-b06c-1ceb707dfef5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:45:32.831922 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11744d8-f79b-49e2-b06c-1ceb707dfef5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:45:32.833427 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11744d8-f79b-49e2-b06c-1ceb707dfef5 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:45:32.855177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1441/2911] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:45:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:45:36.432647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0b84-06fb-4ae9-afa1-39c044649549 service placement] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:45:36.442357 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0b84-06fb-4ae9-afa1-39c044649549 service placement] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:45:36.446278 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa37268-6437-49e3-8dcc-76c2af4d5d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:45:36.446913 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa37268-6437-49e3-8dcc-76c2af4d5d64 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:45:36.447186 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa37268-6437-49e3-8dcc-76c2af4d5d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:45:36.447456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa37268-6437-49e3-8dcc-76c2af4d5d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:45:36.449538 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-aaa37268-6437-49e3-8dcc-76c2af4d5d64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:45:36.464821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa37268-6437-49e3-8dcc-76c2af4d5d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:45:36.466346 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa37268-6437-49e3-8dcc-76c2af4d5d64 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:45:36.477870 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1471/2912] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:45:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:45:42.852386 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=15 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:45.039433 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11744d8-f79b-49e2-b06c-1ceb707dfef5 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:45:45.048517 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11744d8-f79b-49e2-b06c-1ceb707dfef5 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:45:45.052279 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72681710-ed28-4629-92ee-04b606eff73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:45:45.052969 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72681710-ed28-4629-92ee-04b606eff73c service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:45:45.053253 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72681710-ed28-4629-92ee-04b606eff73c service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:45:45.053529 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72681710-ed28-4629-92ee-04b606eff73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:45:45.055363 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-72681710-ed28-4629-92ee-04b606eff73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:45:45.065454 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72681710-ed28-4629-92ee-04b606eff73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:45:45.066919 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72681710-ed28-4629-92ee-04b606eff73c service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:45:45.075284 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1442/2913] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:45:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:45:45.187008 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa37268-6437-49e3-8dcc-76c2af4d5d64 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:45:45.196289 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa37268-6437-49e3-8dcc-76c2af4d5d64 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:45:45.200273 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad9765-77f2-4696-9642-54ffe06bfd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:45:45.201024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad9765-77f2-4696-9642-54ffe06bfd49 service neutron] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:45:45.201324 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad9765-77f2-4696-9642-54ffe06bfd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:45:45.201599 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad9765-77f2-4696-9642-54ffe06bfd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:45:45.203482 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-f7ad9765-77f2-4696-9642-54ffe06bfd49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:45:45.218690 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad9765-77f2-4696-9642-54ffe06bfd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:45:45.220133 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad9765-77f2-4696-9642-54ffe06bfd49 service neutron] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:45:45.231955 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1472/2914] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:45:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:45:55.072149 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=6 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:45:55.226580 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=12 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:46:39.058496 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72681710-ed28-4629-92ee-04b606eff73c service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:46:39.069095 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72681710-ed28-4629-92ee-04b606eff73c service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:46:39.073780 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '11785acde2f74ad481d1224f2a7fd296', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:46:39.074411 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:46:39.074709 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:46:39.074984 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:46:39.077249 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:46:39.087854 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:46:39.089348 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:46:39.097710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1443/2915] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:46:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:46:49.094139 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=6 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:00.606358 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad9765-77f2-4696-9642-54ffe06bfd49 service neutron] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:47:00.619352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad9765-77f2-4696-9642-54ffe06bfd49 service neutron] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:47:00.625352 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374858-261d-424c-8ff2-45e386bfbe7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efdfb91ba4c04452ba547baa184185c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:47:00.626308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374858-261d-424c-8ff2-45e386bfbe7b service nova] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:47:00.626308 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374858-261d-424c-8ff2-45e386bfbe7b service nova] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:47:00.626634 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c374858-261d-424c-8ff2-45e386bfbe7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:47:00.628673 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-2c374858-261d-424c-8ff2-45e386bfbe7b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:47:00.641748 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c374858-261d-424c-8ff2-45e386bfbe7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:47:00.643421 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c374858-261d-424c-8ff2-45e386bfbe7b service nova] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:47:00.657329 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1473/2916] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:47:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:47:07.540794 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:47:07.542292 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:47:07.557117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa66017-94fb-42df-a6a3-e396e2288a12 service neutron] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:47:07.562177 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb16d3-3b14-4ab9-a7cb-d4009f4eb54d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:47:07.562837 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb16d3-3b14-4ab9-a7cb-d4009f4eb54d service placement] REQUEST_METHOD: `GET` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:47:07.563117 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb16d3-3b14-4ab9-a7cb-d4009f4eb54d service placement] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:47:07.563394 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb16d3-3b14-4ab9-a7cb-d4009f4eb54d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:47:07.565405 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-f3cb16d3-3b14-4ab9-a7cb-d4009f4eb54d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:47:07.579205 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb16d3-3b14-4ab9-a7cb-d4009f4eb54d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:47:07.581125 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb16d3-3b14-4ab9-a7cb-d4009f4eb54d service placement] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:47:07.592480 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1444/2917] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:47:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:47:10.652065 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=6 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:10.863966 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374858-261d-424c-8ff2-45e386bfbe7b service nova] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:47:10.931710 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c374858-261d-424c-8ff2-45e386bfbe7b service nova] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:47:10.936444 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:47:10.937367 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:47:10.937647 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:47:10.937938 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] PATH_INFO: `/v3/users/a79d91a8c6d3455ba44eeccd2ba9d979` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:47:10.939148 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79d91a8c6d3455ba44eeccd2ba9d979)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:47:10.941208 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:47:10.992881 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79d91a8c6d3455ba44eeccd2ba9d979'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:10.993511 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79d91a8c6d3455ba44eeccd2ba9d979'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.002496 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79d91a8c6d3455ba44eeccd2ba9d979'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.009714 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79d91a8c6d3455ba44eeccd2ba9d979'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.010332 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79d91a8c6d3455ba44eeccd2ba9d979'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.028918 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1474/2918] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:47:10 2022] DELETE /identity/v3/users/a79d91a8c6d3455ba44eeccd2ba9d979 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:47:11.212833 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb16d3-3b14-4ab9-a7cb-d4009f4eb54d service placement] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:47:11.224589 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb16d3-3b14-4ab9-a7cb-d4009f4eb54d service placement] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:47:11.282939 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:47:11.283721 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:47:11.283998 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:47:11.284274 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] PATH_INFO: `/v3/projects/80030dae585441f483c86fcd0193335d` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:47:11.285470 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=80030dae585441f483c86fcd0193335d)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:47:11.287393 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:47:11.336161 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80030dae585441f483c86fcd0193335d', 'request_id': 'req-c7661a0f-24a5-4b2e-be47-95af11ef7acc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.342441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80030dae585441f483c86fcd0193335d', 'request_id': 'req-c7661a0f-24a5-4b2e-be47-95af11ef7acc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.351540 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80030dae585441f483c86fcd0193335d', 'request_id': 'req-c7661a0f-24a5-4b2e-be47-95af11ef7acc'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.362619 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] The token cache is being invalidate because project 80030dae585441f483c86fcd0193335d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:47:11.362902 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.363710 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.365358 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1445/2919] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:47:11 2022] DELETE /identity/v3/projects/80030dae585441f483c86fcd0193335d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:47:11.369703 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:47:11.371318 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:47:11.384811 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7c9b-5410-494a-bb67-03fb2e6188d5 admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:47:11.446365 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:47:11.447241 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:47:11.447521 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:47:11.447800 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] PATH_INFO: `/v3/users/fdd199a7827d4e49b9d79ddbd89caeeb` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:47:11.449024 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd199a7827d4e49b9d79ddbd89caeeb)` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:47:11.450954 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:47:11.479209 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:11.508566 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd199a7827d4e49b9d79ddbd89caeeb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.509349 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd199a7827d4e49b9d79ddbd89caeeb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.527422 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd199a7827d4e49b9d79ddbd89caeeb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.535284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd199a7827d4e49b9d79ddbd89caeeb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.535906 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.notifications [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd199a7827d4e49b9d79ddbd89caeeb'} {{(pid=80130) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.556391 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1475/2920] 10.222.0.59 () {58 vars in 1223 bytes} [Fri Jul 1 16:47:11 2022] DELETE /identity/v3/users/fdd199a7827d4e49b9d79ddbd89caeeb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:47:11.735441 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] Authenticating user token {{(pid=80131) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:47:11.736783 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.fernet_utils [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80131) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:47:11.752030 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7661a0f-24a5-4b2e-be47-95af11ef7acc admin admin] Validating token access rules against request {{(pid=80131) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:47:11.811140 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '355fb13b7be647a8a84fa02e8179fe7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f78c5209a64d8eb2f67286358f8191', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80131) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:47:11.811915 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:47:11.812191 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:47:11.812458 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] PATH_INFO: `/v3/projects/099b860154aa4958912e87b78e21d234` {{(pid=80131) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:47:11.813701 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=099b860154aa4958912e87b78e21d234)` {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:47:11.815655 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] RBAC: Authorization granted {{(pid=80131) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:47:11.838144 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:11.866558 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '099b860154aa4958912e87b78e21d234', 'request_id': 'req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.872613 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '099b860154aa4958912e87b78e21d234', 'request_id': 'req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.884176 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '099b860154aa4958912e87b78e21d234', 'request_id': 'req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e'} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.896023 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] The token cache is being invalidate because project 099b860154aa4958912e87b78e21d234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80131) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 01 16:47:11.896309 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.897022 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG keystone.notifications [None req-bbc6abff-f1df-4d9e-bec5-ca6609fe6c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80131) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 01 16:47:11.898650 dv-cinder-844961-1-smb devstack@keystone.service[80131]: [pid: 80131|app: 0|req: 1446/2921] 10.222.0.59 () {58 vars in 1232 bytes} [Fri Jul 1 16:47:11 2022] DELETE /identity/v3/projects/099b860154aa4958912e87b78e21d234 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 01 16:47:21.551165 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:47:21.892734 dv-cinder-844961-1-smb devstack@keystone.service[80131]: DEBUG dbcounter [-] [80131] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80131) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 16:49:51.368821 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] Authenticating user token {{(pid=80130) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 01 16:49:51.370556 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:49:51.442951 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6a079-b931-475f-9612-506f143f9d0c admin admin] Validating token access rules against request {{(pid=80130) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 01 16:49:51.523261 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096366d3-793f-43c1-a76f-4bc25787602b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb3ded7163fa400399d1b09079a366ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '346384d95ea34feca944fbe147c50aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80130) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 01 16:49:51.523924 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096366d3-793f-43c1-a76f-4bc25787602b service placement] REQUEST_METHOD: `GET` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 01 16:49:51.524202 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096366d3-793f-43c1-a76f-4bc25787602b service placement] SCRIPT_NAME: `/identity` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 01 16:49:51.524468 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096366d3-793f-43c1-a76f-4bc25787602b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80130) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 01 16:49:51.526731 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.fernet_utils [None req-096366d3-793f-43c1-a76f-4bc25787602b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80130) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 01 16:49:51.538456 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096366d3-793f-43c1-a76f-4bc25787602b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 01 16:49:51.540052 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096366d3-793f-43c1-a76f-4bc25787602b service placement] RBAC: Authorization granted {{(pid=80130) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 01 16:49:51.550284 dv-cinder-844961-1-smb devstack@keystone.service[80130]: [pid: 80130|app: 0|req: 1476/2922] 10.222.0.59 () {60 vars in 1365 bytes} [Fri Jul 1 16:49:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 01 16:50:01.546172 dv-cinder-844961-1-smb devstack@keystone.service[80130]: DEBUG dbcounter [-] [80130] Writing DB stats keystone:SELECT=58 {{(pid=80130) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}